MIT 6.S194 | Open Source Software Project Lab  

Quantifying Users

Topics for today

  • A/B Testing
  • Multi-armed bandit model
  • Cohort analysis

Journal Question

Due next Monday

Quantifying your project's users

This question is similar to last week's question, but focusing on user behavior.

Propose two experiments that might shed useful light on how people use your project. What would you seek to understand? How would you design the experiment? What would different possible outcomes be and what would they mean? What would be complications/confounding factors that make interpreting the result difficult?

Keep in mind that a "user" may be a developer. For example, you could propose measuring how many developers use a new API method you released. And you could provide different populations of developers with different announcements about the API (technical announcements, no announcement, announcements that have example code, announcements that have example benefits, etc).

Please submit your response by class time on each Monday. Here are the Journal guidelines and submission instructions.


Class List

  1. Introduction (W 2/6)
  2. Bootup (M 2/11)
  3. Become a Git Master (W 2/13)
  4. Everything you ever wanted to know about Web Requests (T 2/19)
  5. Design Studio (W 2/20)
  6. Debugging (M 2/25)
  7. Design Studio (W 2/27)
  8. Open Source Business Models (M 3/3)
  9. Design Studio (W 3/6)
  10. Work Day (W 3/11)
  11. Design Studio (W 3/13)
  12. Quantifying Code (M 3/18)
  13. Design Studio (W 3/20)
  14. Spring Break (M 3/25 & 27)
  15. Quantifying Users (M 4/1)
  16. Work day (W 4/3)
  17. Remote Collaboration (M 4/8)
  18. Design Studio (W 4/10)
  19. No class - Patriot's Day (M 4/15)
  20. Design Studio (W 4/17)
  21. Work Day (M 4/22)
  22. Design Studio (W 4/24)
  23. No class - CHI (M 4/29 and W 5/1)
  24. Final Presentations (M 5/6)
  25. Final Presentations (W 5/8)
  26. No class - WWW (M 5/13 and W 5/15)
  27. *Note: Report due W 5/15*