Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
stochastic-sisyphus authored Sep 20, 2024
1 parent 9622b46 commit b615006
Showing 1 changed file with 36 additions and 20 deletions.
56 changes: 36 additions & 20 deletions Web Summarizer/README.md
Original file line number Diff line number Diff line change
@@ -1,20 +1,36 @@
Web Page Summarizer
A Python-based tool that takes a list of URLs, fetches their content, and generates concise summaries using the OpenAI API. This script is designed to handle multiple URLs at once, providing an efficient way to summarize content from various web pages.

Features
Content Extraction: Fetches and processes text from each provided URL.
Summarization: Uses GPT-3.5 to generate summaries of web page content.
Rotating User Agents: Bypasses common 403 errors by simulating different browsers.
Installation
Clone the repository.
Install dependencies:
pip install -r requirements.txt
Replace YOUR_OPENAI_API_KEY in the script with your OpenAI API key.
Usage
Run the script:
python url_summarizer.py
Paste URLs, one per line, and press Enter twice to generate summaries.
Dependencies
requests
beautifulsoup4
openai
**Web Page Summarizer**

A Python-based tool that takes a list of URLs, fetches their content, and generates concise summaries using the OpenAI API. This script efficiently handles multiple URLs, providing streamlined summaries of web page content.

### Features

* **Content Extraction**: Fetches and processes text from each provided URL.
* **Summarization**: Uses GPT-3.5 to generate web page summaries.
* **Rotating User Agents**: Bypasses 403 errors by simulating different browsers.

### Installation

1. Clone the repository.
2. Install dependencies:

```bash
pip install -r requirements.txt
```

3. Replace `YOUR_OPENAI_API_KEY` in the script.

### Usage

1. Run the script:

```bash
python url_summarizer.py
```

2. Paste URLs, one per line, and press Enter twice.

### Dependencies

* `requests`
* `beautifulsoup4`
* `openai`

0 comments on commit b615006

Please sign in to comment.