–
Course Introduction
1 Lecture
01:53
Get an overview of the course and show you the requirements needed to proceed.
Introduction: Course overview and requirements
Preview
01:53
–
Scraping static web pages
4 Lectures
22:40
In this lecture we discuss what a static web page is.
What is a static web page?
Preview
00:52
In this lecture you learn the concept behind scraping static web pages. We look at the concrete steps needed to scrape practically any static page out there. A live example is provided at the end of this section...
Concept: how to scrape static web pages
02:00
We introduce the Jsoup library. It helps downloading, parsing and extracting elements from a page using CSS selectors. It has a lot of similarities of jQuery - so prior knowledge of jQuery is helpful but not necessary.
Also we develop a simple example program using this library...
Jsoup: the jQuery for Java
Preview
05:45
In this example we build a web scraper that gets the top 10 Google search results for any search query and prints the title and url of each search result to the console. Later we store the results in a simple text file.
Example: scraping the top 10 Google search results
14:03
–
Scraping dynamic / AJAX web pages
4 Lectures
30:49
In this lecture we discuss what a dynamic / AJAX web page is and how it differs from a static one.
What is a dynamic / AJAX web page?
Preview
01:55
In this lecture you learn the concept behind scraping dynamic / AJAX web pages. Later we show you how to actually apply this concept to a concrete example.
Concept: how to scrape dynamic / AJAX web pages
02:35
In this lecture you learn how to make HTTP Requests with the Unirest Java library. We develop a simple live example where you can see the most important features for web scraping in action.
Making HTTP Requests with Unirest
11:20
In this example we scrape the results from peoplefinders.com which are loaded dynamically via AJAX requests.
Example: scraping results from peoplefinders.com
14:59
–
Exporting your data
2 Lectures
06:32
In this lecture we export the data from the Google top 10 search results example as CSV for further processing. You can open it in Numbers, Excel or Open Office. There you can do all kinds of sorting and filtering which is really useful.
Export your data as CSV
02:10
In this lecture we export the data from the Google top 10 search results example as JSON for further processing.
Export your data as JSON
04:22
–
Going undercover
1 Lecture
02:22
You will learn how to become invisible and hide traces of beeing a web scraper. This will help you avoid getting blocked or banned.
Bonus: in the resource section you find an undercover web scraper that builds upon the google scraper from the previous lecture. You can use this as a foundation for creating your own scrapers....
How to stay undetected
02:22
–
Conclusion
2 Lectures
01:27
Thank you for taking this online course. You can download the full source code of all lectures here. I will give you an overview of what's next...
Conclusion and what's next
01:20
In this lecture you will find a Mind Map with the contents of the course. So you have a one page overview of all the information.
Bonus: Mind Map of the course content
00:07
آیا می خواهید برنامه نویسی موبایل را با بهترین تکنولوژی شروع کنید؟
به کمک این دوره آموزشی که توسط مدیر سایت گیت تدریس می شود به راحتی اپلیکیشن های Android و iOS و Windows Phone بسازید.
تمامی مباحث از مقدماتی تا پیشرفته آموزش داده می شوند و شرکت کنندگان دوره به مدت نامحدود پشتیبانی می شوند.
برای اطلاعات بیشتر و استفاده از دوره روی لینک زیر کلیک نمایید:
آیا می خواهید طراحی وب را به صورت حرفه ای یاد بگیرید؟
در این دوره آموزشی طراحی وب را در قالب بیش از 72 ساعت آموزش تصویری فارسی فرامیگیرید.
در این دوره HTML5 | CSS3 | Javascript | Jquery | Ajax | Bootstrap4 | PHP | MYSQL | SQL Server | Wordpress آموزش داده می شود.
تمامی مباحث از مقدماتی تا پیشرفته آموزش داده می شوند و شرکت کنندگان دوره به مدت نامحدود پشتیبانی می شوند.
برای اطلاعات بیشتر و استفاده از دوره روی لینک زیر کلیک نمایید:
حجم فایل: 745MB
لینک های دانلود: (Download Links)
موضوع: آموزش جاوا | Java Tutorials آموزش های یودمی | Udemy Courses طراحی وب | Web Development
تگ ها: آموزش web scraping آموزش جاوا آموزش حرفه ای Web Scraping با جاوا فیلم آموزش Web Scraping فیلم آموزش جاوا
تبلیغات
ثبت ديدگاه