Awesome Data Analysis
Section: Tools · A Python & command-line tool to gather text and metadata on the web.
FreshScore 80
Entry
Trafilatura
Appears in 4 awesome lists
Python & Command-line tool to gather text and metadata on the Web - Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
Open github.comadbar/trafilatura
Found in these lists
Awesome Python
Section: Web Scraping · A tool for gathering text and metadata from the web, with built-in content filtering.
FreshScore 94
Awesome AI Agents: Tools, Resources, and Projects
Section: Tools · Python & Command-line tool to gather text and metadata on the Web - Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
SlowScore 68
awesome-python
Section: Scraping and Crawling · Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
FreshScore 81
Often listed next to it
browser-use
Minimal browser-automation agent harness with clean separation of tool registration, DOM state injection, action loop, and error recovery. Small codebase, clear structure — the best "minimal viable harness" reference for understanding core loop mechanics.
In 10 listsDetails
Selenium
Portable software testing framework for web applications. License: Apache 2 , .
In 9 listsDetails
DemoGPT
DemoGPT enables you to create quick demos by just using prompt. It applies ToT approach on Langchain documentation tree.
In 9 listsDetails
Awesome LangChain
😎 Awesome list of tools and projects with the awesome LangChain framework
In 4 listsDetails
playwright-python
Python version of the Playwright testing and automation library.
In 6 listsDetails
scrapy
Fast, high-level web crawling and scraping framework for Python. Extract structured data from websites at scale with built-in support for handling common challenges like pagination, cookies, and concurrent requests. BSD-3-Clause licensed.
In 6 listsDetails
跨境出海技术栈
为独立开发者准备的精选技术栈和工具仓库来了！这里有你最需要的工具，帮你提升开发效率、节约成本，最重要的是——这些工具都是市场上热门的，经过验证的。🚀A curated collection of tech stacks and tools tailored for inde…
In 3 listsDetails
PentestGPT
🟢🔬 — The original USENIX'24 LLM pentest agent; re-released as an autonomous pipeline with strong benchmark results. · updated 2026-07-14)
In 6 listsDetails