Understanding Scraping Multiple URLs Together

You can have many URLs in an array. A word of advice though, do not include any URL unnecessary because whenever we make a request to any URL it costs the website owners in terms of an additional request made to their server.

> _And never run a web scraping script in **infinite** loop_

Once you have created an **array**, start a loop from the beginning and do everything inside the loop:

```python

## storing the content of the page in a variable
html = page.content

## creating BeautifulSoup object
soup = bs4.BeautifulSoup(html, "html.parser")

## Then parse the HTML, extract any data
## write it to a file

When you run multiple URLs in a script and want to write the data to a file too, make sure you store the data in form of a **tuple** and then write it in the file.

Next tutorial is a simple excercise where you will have to run web scraping script on Studytonight's website. Excited? Head to the next tutorial.