Scraping Reddit for Problems

Instead of guessing what people want, I looked for their actual complaints and struggles in an automatic way.
I built a system that listens to real conversations where people naturally express frustration.

How I Made This:

1. Generating Different Questions
I created hundreds of search queries to cast a wide net. For example:

"my business site:reddit.com/r/entrepreneur"
"looking for site:reddit.com/r/entrepreneur"
"how do I site:reddit.com/r/startups"
"struggling with site:reddit.com/r/startups"

2. Finding the Right Communities
I used Firecrawl to automatically search across business subreddits like r/entrepreneur, r/startups, r/smallbusiness, r/marketing - places where people actually talk about their real problems.

3. Extracting the Gold
I analyzed all the conversations and extracted the pain points, ranking them by intensity. Then I put everything into structured JSON data so I could actually work with it.

Result is here and open to download ☺️☺️