Linkscrape

LinkScrape is a dynamic application designed to extract and collect essential links from specific websites. It operates by traversing through the pages of a designated site, meticulously capturing the names of embedded links along with their respective addresses.

Tech Stack

Forking the Repository

To contribute to this project, you need to fork the repository to your GitHub account. Follow the steps below:

1. Fork the repository:
   • Click on the "Fork" button at the top right of this page. This will create a copy of the repository in your GitHub account.

Installation

1. Clone the repository:

   git clone https://github.com/yourusername/Linkscrape.git

2. Navigate to the project directory:

   cd myproject

3. Create a virtual environment:

   python -m venv myenv

4. Activate the virtual environment:

   • On Windows:

     .\myenv\Scripts\activate

   • On Unix or MacOS:

     source myenv/bin/activate

     • To install all the requirements:

     pip3 install -r requirements.txt

5. Run the development server:

   python manage.py runserver

6. Visit http://127.0.0.1:8000/ in your browser.

7. Database Migrations:

   python3 manage.py makemigrations
   python3 manage.py migrate

8. Creating Branches and Adding Changes

To contribute to the project, it's recommended to create a new branch for each feature or bug fix. Follow these steps:

1. Create a new branch:

   • Navigate to your project's directory:

     cd Linkscrape

   • Create a new branch for your changes:

     git checkout -b feature-or-bugfix-branch

2. Make changes:

   • Make the necessary changes to the code, add new features, or fix bugs.

3. Stage and commit your changes:

   • Stage your changes:

     git add .

   • Commit your changes with a meaningful message:

     git commit -m "Add your meaningful commit message here"

4. Push your branch to your fork:

   • Push your changes to your forked repository:

     git push origin feature-or-bugfix-branch

5. Submit a Pull Request:

   • Go to your forked repository on GitHub.
   • Click on "Compare & pull request" for the branch you just pushed.
   • Fill in the pull request details and submit it.

Contributions

Open for contributions. Just clone and follow the installation. Create an issue, make changes and raise a PR detailing about the changes made.

Future Plans

• Content based Filtering
• UI/UX enhancement
• AI driven tags
• File extraction in CSV, JSON
• Adding geolocation
• Analytical Dashboard

License

This project is licensed under the MIT License - see the LICENSE file for details.