Tuesday, March 28, 2017
Birchbox vs Ipsy A One Year Analysis by the Numbers
Birchbox vs Ipsy A One Year Analysis by the Numbers
There are a lot of beauty box subscription services out there and they all bring something different to the table. Two of the most oft-compared are Birchbox and Ipsy, likely because they both cost $10 a month. I have now received 15 Birchboxes and 14 Ipsy bags, so it seemed like an opportune time to get into a nitty gritty comparison.
However, I quickly realized that there were a lot of different ways I could approach this comparison. I chose the four ways that I thought would be the most valuable for anyone who is trying to decide if they should join Ipsy or Birchbox. The following sections include:
- Test 1 - A t-test comparing the estimated retail values of the two boxes.
- Test 1 - A similar t-test where the products that were not valuable to me, personally, were eliminated.
- An addendum to Tests 1 and 2 that considers the value of points.
- Test 3 - A Chi-square test examining what happens if the two boxes simply go head-to-head.
- Test 4 - A comparison of the products I actually purchased after sampling them.
- My subjective thoughts and conclusions.
 |
| WHICH ONE? |
Test 1 - Raw Value
The Description: I calculated the value of my Birchbox and Ipsy the same way that I do every month based on approximate retail value. For example, if a full size product is 1 oz and retails for $30, a 0.25 oz sample would have an approximate retail value of $7.50. I then did a t-test to determine whether Ipsy or Birchbox sends out boxes with higher retail values.
The Benefits: Its an objective test. It could be re-created by anyone. There is no part of this test that is based on how I feel about the box, so if our preferences are different, this test would still be applicable to you.
The Disadvantages: Any of you who have gotten subscription boxes already know that youre probably going to get shit that cant use, at least some of the time. Someone could send me a bottle of Chanel Foundation, but if you send it to me in "Tawny Beige" its disingenuous to pretend that its worth $65 because I cant use it.
Birchbox
September 2012
Kate Spade New York Twirl (0.05 oz), approximate retail value $1.18
A Twistband Hair Tie, approximate retail value $1.50
A Tili Bag, approximate retail value $0.71
WEI to go Sleepover Kit (1.0 and 3.0ml), approximate retail value $3.80
21 Drops Aromatherapy Blend in "Focus" (2 ml), approximate retail value $7.73
Birchbox and Color Club Custom Collection Nail Polish (.25 oz), approximate retail value $4.00
Total value of the box: $18.92
October 2012
Lulu Organics Lavender and Clary Sage Hair Powder (5g), approximate retail value $1.32
A Luna Bar in Lemon Zest, approximate retail value $1.25
Karuna Hydrating Treatment Mask, approximate retail value $7
Embryolisse Lait-Creme Concentre 24-Hour Miracle Cream (4ml), approximate retail value $2.13
Naked Princess Naked Shine Luscious Lip Gloss (0.008oz), approximate retail value $2.08
Total value of the box: $13.78
November 2012
Oscar Blandi Pronto Texture & Volume Spray (1 oz), approximate retail value $6.25
Miracle Skin Transformer Vanish Instant Imperfection Corrector (0.1 oz), approximate retail value $5.80
Chuao Chocolatier Assorted ChocoPod in Potato Chip, approximate retail value $1.14
Atelier Cologne Rose Anonyme Petite Cologne Absolue (.05 oz), approximate retail value $3.75
Stila All Over Shimmer Liquid Luminizer, approximate retail value $6.67
Total value of the box: $24.01
December 2012
Thymes Body Lotion in Naia (1.5 oz), approximate retail value $4.05
Thymes Body Lotion in Lotus Santal (no size listed, about 0.15oz), approximate retail value $0.41
Keratase Nutritive Nectar Thermique (0.68 oz), approximate retail value $5.60
ModelCo Shine Ultra Lip Gloss in Berry Pink, retail value $16.00
Juice Beauty Stem Cellular Repair CC Cream in Natural Glow (0.17 oz), approximate retail value $3.90
Total box value: $26.23
January 2013
Lumiere dhiver Clarifying Shampoo (1.75oz), approximate retail value $6.67
Fresh Lotus Youth Preserve Face Cream (0.14oz), approximate retail value $3.48
Harvey Prince Skinny Chic (estimated at 2ml), approximate retail value $1.82
Lashem Double Trouble Mascara (estimated at 1ml), approximate retail value $4.76
TheBalm Hot Mama (1g), approximate retail value $3.11
Total Box Value: $19.84
February 2013
Beauty Protector Protect and Detangle (estimated 1.25 oz), approximate retail value $4.12
Color Club Nail Polish in Wild Cactus (0.25 oz), approximate retail value $4.00
Dr. Jart+ Black Label Detox Beauty Balm (0.1 oz), approximate retail value $2.13
Juicy Couture Couture La La Perfume (0.05 oz), approximate retail value $1.32
Ghirardelli Milk and Caramel Square, approximate retail value $0.42
Total box value: $11.99
March 2013
Whish Shave Crave Shaving Cream in Blueberry (0.75oz), approximate retail value $2.93
Madewell for Birchbox Nail Emery Board, approximate retail value $5
Benefit Stay Dont Stray Primer (0.09oz), approximate retail value $7.09
Evologie Intensive Blemish Serum (0.17oz), approximate retail value $11.90
Twistband Headband, approximate retail value $3.17
Total Box Value: $30.09
April 2013
Nexxus Youth Renewal Rejuvenating Elixir (0.14 oz/4mL), approximate retail value $3.00
LaFace Laboratories PUR Purifying Face Wash (0.1oz/3mL), approximate retail value $0.64
Folle de Joie eau de parfum (0.06oz/2mL), approximate retail value $1.73
Mirenesse Glossy Kiss in Flirty Kiss (0.15oz/4g), approximate retail value $26.55
Simple Revitalizing Eye Roll-on (0.5oz/15mL), approximate retail value $10.99
Total Box Value: $42.91
May 2013
Amika Obliphica Nourishing Mask (0.67oz), approximate retail value $1.60
Sumita Color Contrast Eyeliner in Suman/Black (0.024oz), approximate retail value $5.25
Run Guyausa Tea (4 bags), approximate retail value $1.75
COOLA Classic SPF 30 Cucumber Moisturizer for Face (0.23oz), approximate retail value $4.33
Marvis Toothpaste in Classic Mint (0.5oz), approximate retail value $2.10
Total Box Value: $15.03
June 2013
Suki Exfoliate Foaming Cleanser (0.25 oz), approximate retail value $2.06
Klorane Gentle Dry Shampoo with Oat Milk (1.06 oz), approximate retail value $5.90
SW Basics Lip Balm Flights in Cinnamon, approximate retail value $3.75
Tweezerman Filemate Matchbox Itty Bitty Nail Files, retail value $7.99
Color Club Wanderlust in London Calling (0.25oz), approximate retail value $2.00
Total Box Value: $21.70
July 2013
100% Pure Green Apple Nourishing Body Cream (0.198 oz), approximate retail value $0.37
Benefit Cosmetics Girl Meets Pearl (0.25 oz), approximate retail value $18.75
Number 4 Super Comb Prep & Protect (estimated 0.75 oz), approximate retail value $3.55
Benta Berry G-1 Moisturizing Face Cream (0.16 oz), approximate retail value $3.52
Birchbox Bobby Pins (2), approximate retail value $1.67
Total Box Value: $27.86
August 2013
Dr. Jart+ Premium BB Cream SPF 45+ (5ml/0.17 fluid oz), approximate retail value $4.42
Jasmine Seven Fresh Feet Wipes (2 wipes), approximate retail value $0.66
ModelCo Party Proof Lipstick in Disco Fever (1 at 0.13oz), approximate retail value $8.00
Violet Oasis 100% Organic Argan Oil (4ml/0.14 fluid oz), approximate retail value $2.66
TanTowel Classic Formula Self-Tan Towlette (1 towelette at 0.25oz), approximate retail value $2.40
Total Box Value: $18.14
September 2013
Yes to Grapefruit CC cream in Light and Light Medium (estimated 0.1oz), estimated retail value $0.94
VOESH New York Collagen Gloves - Premium Manicure Hand Mask (1 set of gloves), approximate retail value $6.67
Yes to Blueberries Age Refresh Cleansing Facial Towelettes (8 wipes), retail value $2.99
Ruffian Nail Lacquer in Hedge Fund (full size at 0.17oz), retail value $10
Coastal Scents Eyeshadow Sample in Set 34 Thrill Ride (0.07oz), approximate retail value $3.06
Total Box Value: $23.66
October 2013
TheBalm Stainiac in Beauty Queen (0.04 fluid oz), approximate retail value $2.27
Beauty Protector Protect and Detangle Protect & Shampoo Daily Shampoo (estimated 0.75 fluid oz), estimated retail value $2.05
Beauty Protector Protect and Detangle Protect & Condition Daily Conditioner (estimated 0.75 fluid oz), estimated retail value $2.05
Evologie Stay Clear Cream (0.33oz), approximate retail value $20.46
Chapstick Hydration Lock (full size at 0.15oz), retail value $2.99
Total Box Value: $29.82
November 2013
Eyeko Skinny Liquid Liner (0.04oz), approximate retail value $9.14
Mighty Leaf Tea Pouches in Green Tea Tropical, Organic African Nectar, and Vanilla Bean, approximate retail value $1.99
Vasanti Brighten Up! Enzymatic Face Rejuvenator (0.71oz), approximate retail value $5.67
BeeKind Body Lotion (1.01 fluid oz), approximate retail value $1.89
Color Club Cocktail Hour Collection in On the Rocks (0.25 fluid oz), approximate retail value $4.00
Total Box Value: $22.69
Birchbox Statistics:
Data Set- $18.92, $13.78, $24.01, $26.23, $19.18, $11.99, $30.09, $42.91, $15.03, $21.70, $27.86, $18.14, $23.66, $29.82, $22.69
Mean Value- $23.07
Median Value- $22.69
Standard Deviation- $7.82
Range of Values- $11.99 to $42.91
Range- $30.92
Ipsy
October 2012
Coastal Scents Eye Shadow Quad (0.07 oz), approximate retail value $3.06
Couture Colour Pequi Oil Treatment (0.5oz), approximate retail value $12.00
Be a Bombshell Eye Liner in Onyx, approximate retail value $14.00
Mirenesse Lip Bomb Glossy Lacquer Stain, approximate retail value $35.10
theBalm Whats Your Type? "the body builder" Mascara (0.11 oz), approximate retail value $5.50
Total Box Value: $69.71
November 2012
Nailtini Nail Polish in Millionaire, approximate retail value $13.00
Chella Eyebrow Defining Gel, approximate retail value $18.00
BareMinerals Marvelous Moxie Lipgloss in Dare Devil, approximate retail value $8.40
Starlet Peace, Love & Chocolate Eyeliner, approximate retail value $11.00
Meet Matt(e) eyeshadow in Matt Batali, approximate retail value $3.83
Total Box Value: $54.23
December 2012
Urban Decay 24/7 Glide-On Eye Pencil in Zero (0.8g), approximate retail value $12.67
Be a Bombshell Lip Gloss in Hot Mess, retail value $14.00
NYX Ultra Pearl Mania in Mink Pearl, retail value $3.00
Mirabella Prime for Face and Eyes, retail value $29.00
Mai Couture Highlighter "Papier" in St. Barts (25 sheets), approximate retail value $14.00
Total Value of the Box: $72.67
January 2013
Argan Oil by Josie Maran Cosmetics (0.17oz), approximate retail value $4.17
Pacifica Tuscan Blood Orange Body Butter (2.5oz), retail value $7.00
Big Sexy Hair Spray and Play (1.6oz), retail value $6.00
Nailtini in Bloody Mary, retail value $13.00
Soho New York Eyeliner Brush, retail value $7.99
Total Box Value: $38.16
February 2013
Lash Cards (4), approximate retail value $2.80
Pixi Flawless and Poreless Primer (0.5oz), approximate retail value $14.50
Mica Beauty Gel Eyeliner in Black (3g), approximate retail value $18.00
Pop Beauty Smokey Lash Kapow Mascara (0.17oz), approximate retail value $12.58
Coastal Scents mini quad in Candlelight, Gunmetal, Incognito and Ashen (0.07oz), approximate retail value $2.24
Total box value: $50.12
March 2013
Juice Beauty Hydrating Mist (1oz), approximate retail value $3.38
LA Fresh Travel-Lite Makeup Remover Wipes (8 count), approximate retail value $1.49
Glam RX Mini Freestyle Palette, estimated retail value $4
Yaby Eyeshadow Refill (2 at estimated 0.02oz each), estimated retail value $1.54
Total Box Value: $10.41
April 2013
Sation Nail Color in Love At First Byte, retail value $5.95.
Big Sexy Hair Powder Play (0.07oz), approximate retail value $1.98.
Be a Bombshell Blush in Sweet Cheeks, retail value $16.
Two Cosmetics Duo Eyeshadow in Heartache, retail value $5.75
Total Box Value: $29.68
May 2013
Zoya Nail Polish in Julie, retail value $8.00
Pacifica Island Vanilla Perfume Roll-On, retail value $12.00
Pacifica Coconut Crushed Pearl Bronzing Body Butter Mini, retail value $7.00
Yaby Concealer Refill in Honey (2g), approximate retail value $2.77
Mirabella Shimmerati Glimmer Gloss, retail value $16.00
Total Box Value: $45.77
June 2013
Starlooks Lip Pencil in Tipsy (2.4g/0.08oz), retail value $12.00
Chella Ivory Lace Highlighter (1.4g/0.05oz), retail value $18.00
Psssst! Instant Dry Shampoo (1.76oz), retail value $3.50
J Cat Sparkling Cream Palette in Suzie (0.1oz), retail value $4.49
NYX Rouge Cream Blush in Natural (0.12oz), retail value $6.00
Total Box Value: $43.99
July 2013
BH Cosmetics California Collection Eyeshadow Sample (estimated 0.09 oz), estimated retail value $0.62
Pop Beauty Pouty Pop Crayon in Coral Crush (0.1 oz), approximate retail value $4.17
Coola Rose Essence Tinted Moisturizer (0.23 oz), approximate retail value $4.87
Healthy Sexy Hair Soy Renewal Beach Spray (1.7 oz), approximate retail value $8.88
Nailtini Nail Polish in Mai Tai (0.5 oz), retail value $6
Total Box Value: $24.54
August 2013
Urban Decay Revolution Lipstick in 69 (0.03oz), approximate retail value $7.33
Mica Beauty Shimmer Powder in Bronze (full size at 0.1oz), retail value $14.95
Smashbox Photo Finish Foundation Primer (0.25oz), approximate retail value $9.75
Michael Todd True Organics Pumpkin Nutrient Rich Facial Mask (1oz), approximate retail value $10.00
Pixi Lash Booster (estimated 0.1 fluid oz), estimated retail value $6.80
Total Box Value: $48.83
September 2013
Victoria Jackson Taupe Eyebrow Pencil (full size at 0.1oz), retail value $14.95
Cailyn Tinted Lip Balm in Big Apple (full size at 0.14oz), retail value $19
Starlooks Kohl Eye Pencil in Obsidian (full size at 0.08oz), retail value $12
NYX Single Eyeshadow in Morocco (full size at 0.085oz), retail value $4.50
Elizabeth Mott Its So Big Volumizing Mascara (0.14 fl oz), approximate retail value $8.00
Total Box Value: $58.45
October 2013
Ole Henriksen Truth Creme Advanced Hydration (0.25 fluid oz), estimated retail value $6.72
Nourish Organic Coconut and Argan Body Lotion (1 fluid oz), estimated retail value $1.25
Buxom Lip Polish in Dolly (0.07 fluid oz), estimated retail value $8.87
Big Sexy Hair Blow Dry Volumizing Gel (1.7 fluid oz), estimated retail value $3.39
Zoya Nail Polish in Mason (full size at 0.5 fluid oz), retail value $8.00
Total Box Value: $28.23
November 2013
Em Cosmetics by Michelle Phan Lash Gallery Lengthening Mascara in Black (full size at 0.236 fluid oz), retail value $20
Starlooks Gem Eye Pencil in Amethyst (full size at 0.08oz), retail value $14
Be A Bombshell Lip Crayon in Hot Damn (full size at 0.09oz), retail value $14
Pixi Beauty Bronzer in Subtly Suntouched (0.11oz), approximate retail value $5.50
GlamGlow YouthMud Tinglexfoliate Treatment (travel size at 0.5 fluid oz), retail value $19
Nailtini Nail Lacquer in Caviar Cocktail (full size at 0.5 fluid oz), retail value $13
Total Box Value: $85.50
Ipsy Statistics:
Data Set- $69.71, $54.23, $72.67, $38.16, $50.12, $10.41, $29.68, $45.77, $43.99, $24.54, $48.83, $58.45, $28.23, $85.50
Mean Value-$47.16
Median Value- $47.30
Standard Deviation- $20.45
Range of Values- $10.41 to $85.50
Range- $75.09
T-test Comparison:
A t-test showed that the difference between the two services was extremely statistically significant, t(27)=4.25, p=0.0002. Ipsy tends to send out boxes that have higher retail values, and that difference is robust.
Test 2 - Personal Value
The Description: This test is similar to Test #1, except that I eliminated the products that didnt add value to my box. A product added value if I was glad to have received it. A product I wanted to try would add value (even if I didnt end up liking it). A product I didnt expect to like but ended up enjoying would also add value. As a side note, I am only including products that gave me value outside of blogging. For example, it was a Juice Beauty product I received from Birchbox that originally inspired my "Beauty Bullshit" series. For the purposes of this test, that doesnt count as value (even though I hope those posts are valuable!).
The Benefits: This test takes into account the fact that subscription services are sometimes going to send out crap without asking me to come up with subjective values for products.
The Disadvantages: There is no objective measure for "crap". There is someone out there who likes products that I hate. If you have a different idea about what is crap, you may find that your results are different. I can only tell you what I didnt like and didnt use.
Birchbox Test #2
September 2012
A Twistband Hair Tie, approximate retail value $1.50
WEI to go Sleepover Kit (1.0 and 3.0ml), approximate retail value $3.80
21 Drops Aromatherapy Blend in "Focus" (2 ml), approximate retail value $7.73
Birchbox and Color Club Custom Collection Nail Polish (.25 oz), approximate retail value $4.00
Total Personal Value: $17.03
October 2012
Lulu Organics Lavender and Clary Sage Hair Powder (5g), approximate retail value $1.32
Karuna Hydrating Treatment Mask, approximate retail value $7
Total Personal Value: $8.32
November 2012
Oscar Blandi Pronto Texture & Volume Spray (1 oz), approximate retail value $6.25
Miracle Skin Transformer Vanish Instant Imperfection Corrector (0.1 oz), approximate retail value $5.80
Chuao Chocolatier Assorted ChocoPod in Potato Chip, approximate retail value $1.14
Atelier Cologne Rose Anonyme Petite Cologne Absolue (.05 oz), approximate retail value $3.75
Stila All Over Shimmer Liquid Luminizer, approximate retail value $6.67
Total Personal Value: $24.01
December 2012
Thymes Body Lotion in Naia (1.5 oz), approximate retail value $4.05
Thymes Body Lotion in Lotus Santal (no size listed, about 0.15oz), approximate retail value $0.41
ModelCo Shine Ultra Lip Gloss in Berry Pink, retail value $16.00
Available link for download
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment