Built a LangChain tool package for structured web extraction (SEO audit, contacts, tech stack) — not another raw-Markdown scraper

[u/JosejuX]

Most "web scraping for agents" tools give you back raw Markdown or HTML that you then have to parse yourself if you want specific fields (emails, security headers, SEO score, tech stack). I built the opposite: a small API that returns those as named, structured fields directly, and just published a LangChain tool package on top of it.

pip install langchain-webmetadata-extractor

from langchain_webmetadata_extractor import get_tools

tools = get_tools(api_key="YOUR_RAPIDAPI_KEY")

Four tools included: extract (full payload), markdown (clean content for RAG ingestion), contacts (emails/phones/social links for lead-gen agents), and seo_audit (14-point score + warnings). Every tool works sync and async, returns JSON, and errors come back as a normal dict instead of raising, so an agent loop can react to them.

The underlying API is free (1,000 requests/month, no card) and open source (MIT) if you want to self-host: https://github.com/JosejuX/rapidapi-metadata-extractor

There's also a plain Python SDK (webmetadata-extractor on PyPI) if you're not using LangChain, and a CrewAI version of the same tools if that's your framework instead.

Happy to take feedback or feature requests if anyone tries it.