this article has moved: https://solomonmg.github.io/blog/2014/visualization-series-the-scatterplot-and-understanding-the-diamond-market/
-
Recent Posts
- Response to FiveThirtyEight’s Podcast about our paper, “Projecting confidence”
- Replication of Study 2 in Bias in the Flesh: Skin Complexion and Stereotype Consistency in Political Campaigns
- Exposure to Ideologically Diverse News and Opinion, Future Research
- When to Use Stacked Barcharts?
- Visualization Series: Using Scatterplots and Models to Understand the Diamond Market
- Streamline Your Mechanical Turk Workflow with MTurkR
- Generating Labels for Supervised Text Classification using CAT and R
- Working with Bipartite/Affiliation Network Data in R
- Visualization series: Insight from Cleveland and Tufte on plotting numeric data by groups
- Putting it all together: concise code to make dotplots with weighted bootstrapped standard errors
- Map the distribution of your sample by geolocating ip addresses or zip codes
Archives
Categories
Meta
Solomon Messing 
Pingback: Visualization Series: Using Scatterplots and Mo...
Solomon, thanks especially for this paragraph. I have been following the opposite convention, but I think you have convinced me.
R style note: I started using the “=” operator over “<-” after reading John Mount’s post on the topic, which shows how using “<-” (but not “=”) incorrectly can result in silent errors. There are other good reasons: …..
Cool analysis, and glad to see that you have endorsed Mount’s recommandation on assignment. Teaching R to undergrads confirmed to me that = is also much more intuitive to beginners. However, Mount told me that they had removed that recommandation from the book, to avoid vexing anyone following a different R style guide.
Great read, and thanks a ton for the scraped data! I was looking at how to get the recent info from diamondse.info, and will do the analysis myself. You saved me the trouble of mining the site!
Thanks Solomon. Great article, which I was directed to through the Udacity course (just finished it!)
This is so technical absolutely what I wan looking for!
Super useful analysis Solomon. I riffed on it a little bit when I was shopping for engagement rings for my now fiance (!) — she liked cushion diamonds — and turned it into a little Shiny App so I could negotiate w/ dealers on the fly.
https://cushioncalc.shinyapps.io/cushioncalc/
Matthew this is awesome, congrats to you and your new fiancee. Hope you got a solid deal 🙂
How did you print each element of modelEstimate separately?
predict.lm returns a vector of arguments (fit, lwr, upr) — just sliced for the one I want.
https://stat.ethz.ch/R-manual/R-patched/library/stats/html/predict.lm.html
Or see for yourself: https://github.com/hudsonsuds/cushioncalc/blob/master/cushioncalc/server.R
On Thu, May 14, 2015 at 4:48 AM, Solomon Messing wrote:
> Saurabh commented: “How did you print each element of modelEstimate > separately?”
How much time does it take to extract the data using the python script?
I believe it took a few hours
Is it possible to print each element of modelEstimate separately? fir lwr and upr separately
Dear Solomon,
I hope all is well and that you are still having fun with academia. Will you be in San Diego any Tuesday or Thursday in May? I could use you as a guest speaker. We are discussing plotting today, for example.
Roger
Hi Roger, I wish I was taking a trip to San Diego in May! Will definitely let you know next time I’m headed down there.
Hey Solomon, great post! 🙂 I wanted to ask, have you defined any – log10_trans() and trans_new() functions anywhere? which are used in the analysis?
Hi Solomon, Thank you for sharing your wonderful work.
Very informative and detailed. I am taking the Udacity class now. Also, thanks for the scraping tool and updated diamond prices data. I hope your fiancee was happy with your choice. I have mixed thoughts on the obligatory engagement ring. I believe the diamond ring will go the way of the rhinestone ring, and will become a much cheaper fashion statement in the future. As in the Diamond Age novel, diamonds will be industrially manufactured in large quantities. However, it is difficult to go against the current social norm in such a traditional social sphere as marriage.