Live Insight Scraper

Live Insight Scraper is a modern web application that empowers users to instantly fetch, summarize, and read live insights from across the web. Designed for speed, clarity, and accessibility, it combines the power of real-time web search with advanced AI summarization to deliver concise, readable content on any topic you care about.

---

What Does It Do?

• Instant Web Insights: Enter any query and get up-to-date information scraped from the web.
• AI-Powered Summaries: Long, complex search results are distilled into clear, readable summaries using state-of-the-art AI models.
• Seamless Experience: A clean, intuitive interface lets you focus on the information you need, not the noise.
• Free & Open Source: Built with open technologies and hosted on free platforms, so anyone can use or extend it.

---

Key Features

• Live Search: Connects to the web in real time to fetch the latest information for your queries.
• Automatic Summarization: Uses HuggingFace transformers to generate concise summaries from raw search results.
• Modern UI: Built with React for a fast, responsive, and user-friendly experience.
• Accessible Anywhere: Frontend is hosted on GitHub Pages, backend on Render—no installation required.
• Open Source: Fork, modify, or contribute on GitHub!

---

Use Cases

• Quickly research a topic and get the gist without sifting through multiple articles.
• Stay updated on current events, trends, or technical topics.
• Summarize complex or lengthy web content into digestible insights.
• Great for students, journalists, analysts, and the curious-minded.

---

Technology Stack

• Frontend: React, Vite, GitHub Pages
• Backend: FastAPI, HuggingFace Transformers, Render
• Web Scraping: httpx, BeautifulSoup

---

Getting Started

Prerequisites

Before running this project, make sure you have the following installed:

• Node.js (v18+): Download
• • Python (3.8+): Download
  • • pip: Python package manager (usually comes with Python)

    • • npm or yarn: Node package manager

      • Installation

      • 1. Clone the Repository

      • git clone https://github.com/RogueTex/AdvancedInsights.git
        cd AdvancedInsights

        2. Set Up the Backend (Python)

        # Create a virtual environment
        python -m venv venv
        
        # Activate the virtual environment
        # On macOS/Linux:
        source venv/bin/activate
        # On Windows:
        venv\Scripts\activate
        
        # Install Python dependencies
        pip install -r requirements.txt

        3. Set Up the Frontend (Node.js)

        # Install Node dependencies
        npm install
        
        # Or using yarn
        yarn install

        Running Locally

        Start the Backend Server

        # Make sure your virtual environment is activated
        python main.py

        The backend will typically run on http://localhost:8000

        Start the Frontend Server

        # In a new terminal, from the project root
        cd frontend
        npm run dev
        
        # Or using yarn
        yarn dev

        The frontend will typically run on http://localhost:5173

        Usage

        1. Open your browser and navigate to http://localhost:5173 (or the port shown in your terminal)
        2. 2. Enter a search query in the search box
           3. 3. The application will fetch and summarize live insights from the web

              4. 4. View the AI-generated summaries of the results

                 5. Building for Production

                 6. # Build the frontend
                    cd frontend
                    npm run build
                    
                    # Deploy according to your hosting platform (GitHub Pages, Render, etc.)

                    ---

License

MIT — Free to use, share, and improve.

---

Get Involved

We welcome contributions, feedback, and ideas! Check out the code or open an issue to get started.