🕵️‍♂️ AI Web Scraper Agent

Welcome to AI Web Scraper Agent, a powerful and user-friendly app to scrape websites using natural language via OpenAI or Llama 3.2 (Ollama).
Perfect for quick data extraction, content collection, or research — just give it a prompt and a URL, and let the AI do the rest!

🌍 Use Cases

• 📰 Extract news from media sites

• 📊 Pull data from tables or pages

• 📦 Scrape product info from e-commerce platforms

• 📚 Collect structured knowledge from articles or blogs

🗂️ Project Structure

AI_WebScraper/

├── agents/

│ ├── openai_scraper.py # Scraper logic using OpenAI

│ └── llama_scraper.py # Scraper logic using Llama 3.2

├── app/

│ ├── main_openai.py # Streamlit app using OpenAI

│ └── main_llama.py # Streamlit app using Llama

├── requirements.txt # Dependencies

└── README.md

🔑 API Keys Required

🧠 Powered by

• Streamlit

• ScrapeGraphAI

• OpenAI API

• Ollama

📜 License

📄 This project is released under the MIT License.

🧑‍💻✨ Happy coding