Show HN: POC to scrape and structure HTML into JSON for RAG

structured.pages.dev

6 points by nirvanist 17 hours ago

Hey all,

I built a quick PoC that scrapes a webpage, sends the content to Gemini Flash, and outputs a clean, structured JSON — ready for RAG workflows.

In my case, I’ll use this structured data to enhance models by integrating external knowledge sources during the generation process.

Curious if you think this has potential or if there are any use cases I might have missed. Happy to share more details if there's interest!

mahi_novice 18 minutes ago

Do you mind sharing more about the implementation details? Any safeguards you have for the urls and all?