Web Scraping using API, Beautiful Soup using Python
Scrape your first web page using Python API, Beautiful soup and structure the data using Python and SQL
Development ,Programming Languages,Python
Lectures -39
Resources -3
Duration -3.5 hours
Lifetime Access
Lifetime Access
30-days Money-Back Guarantee
Get your team access to 10000+ top Tutorials Point courses anytime, anywhere.
Course Description
Scrape your first web page using Python API, Beautiful Soup and structure the data using Python and SQL
API Python:
This section helps you understand the working on API and how to implement the same using Python.
Here we will learn how to get and post the request using API and implement the same.
Will create a simple currency conversion calculator using JSON.
We will also cover API for a website which we need to sign in. We will be using the API keys and ID to log in and fetch the details.
We will explain how to structure and export the data in CSV using Pandas.
Web Scraping:
This Section helps you to learn how to scrape the data and store the data in our desired Format.
Here we will have the data scraped and use parsing of data and store it in Pandas for reference.
Helps in Understanding the structure of HTML and Javascript file to parse the data.
2 Projects to Scrape the data and parse them as our wish and store them in SQL
Beautiful Soup:
It is easy to learn and master. for example, if we want to extract all the links from the webpage
It has good comprehensive documentation which helps us to learn things quickly.
It has good community support to figure out the issues that arise while we are working with this library.
Goals
- To scrape data from the website
- Read information from the API
- Learn to use API, Beautiful Soup and Scrappy for Web crawling and Scraping
Prerequisites
- Basics of Python and HTML
- Installation of Python and Jupiter notebook
Curriculum
Check out the detailed breakdown of what’s inside the course
API
13 Lectures
- Introduction to API 03:29 03:29
- Introduction to HTTP 04:18 04:18
- Introduction to JSON 02:21 02:21
- Installation of Python and Jupyter Notebook 02:43 02:43
- Installation of HTML request 01:11 01:11
- Get response from API 06:30 06:30
- Get JSON Response 02:20 02:20
- Get historical data 05:41 05:41
- How to handle wrong request in API? 01:23 01:23
- Itunes API and reading the value 04:37 04:37
- Project2: Edamam - Registration 03:14 03:14
- Getting response API from registered website 13:50 13:50
- Project 3: Currency convertor calculator 09:17 09:17
Web scraping and Beautiful Soup
11 Lectures
Web scraping using Scrapy
14 Lectures
Instructor Details
Chandramouli Jayendran
I am a software engineer turned into stock trader. Author of 12+ courses with more than 50K students enrolled. I am very passionate on teaching office productivity, software programming and stock market analysis.
Worked with teaching several corporate on Office productivity and Programming. Running an teaching centre of my own.
Trade in stock market whenever I could see opportunity.
Course Certificate
Use your certificate to make a career change or to advance in your current career.
Our students work
with the Best
Related Video Courses
View MoreAnnual Membership
Become a valued member of Tutorials Point and enjoy unlimited access to our vast library of top-rated Video Courses
Subscribe nowOnline Certifications
Master prominent technologies at full length and become a valued certified professional.
Explore Now