پیشنهاد فرادرس

استخراج داده ها از سایت های محبوب با Python و Ruby

دسته بندی ها: آموزش های یودمی (Udemy) ، آموزش طراحی وب ، آموزش روبی (Ruby) ، آموزش پایتون (Python)

تا حالا شده به فکر استخراج داده ها از یک سایت بزرگ با برنامه نویسی باشید؟ این کار به تخصص بالایی نیاز دارد اما می توانید درامد خوبی از این راه داشته باشید!

در این آموزش تصویری با نحوه استخراج داده ها از سایت های محبوب با Python و Ruby آشنا می شوید. این دوره نحوه استخراج داده های سایت های مشهور مانند Zillow ، Yelp ، IMDB ، Google ، YouTube ، Twitter را آموزش می دهد. این دوره آموزشی محصول موسسه Udemy است.

سرفصل های دوره:

  • نحوه نصب و اجرای برنامه
  • نحوه استخراج اطلاعات از IMDB
  • نحوه استخراج داده ها از Macys
  • استخراج کد پستی از Yelp
  • نصب و راه اندازی Ruby
  • نحوه دسته بندی محصولات در Walmart
  • کار با نتایج جستجو در گوگل
  • نحوه استفاده از JSON
  • نصب و راه اندازی پایتون
  • نحوه انتخاب یک فرم
  • نحوه نصب PhantomJS
  • کار با پایگاه داده MySQL
  • نحوه جستجو کلمات کلیدی
  • و...

عنوان دوره: Udemy Web Scraping with Python, Ruby And import. io for fun And profit مدت زمان: 4 ساعت نویسنده: Charlie Craine

توضیحات:

This course teaches you three ways to scrape websites:
Import. io is a software that you download and is a really quick way to start web scraping quickly. It is not without its limitations but depending on what you need or plan to do it could do everything you need. No programming experience necessary!
If you prefer to learn a little programming along the way, and aren't afraid to invest a little time, you can learn how to do web scraping with Ruby and/or Python. Both have their pluses and minuses but both can do just about anything you could imagine.
Even if you have never used Python or Ruby you can learn how to still use these programs as a web scraper. But if you are willing to learn you can scrape just about any website there is online!
Want to do some web scraping of super popular websites? That's how you will learn!
This course comes complete with code for every lecture for Ruby and Python!
You will learn to web scrape popular websites like:
Zillow
Yelp
IMDB
Wikipedia
Google
Macys
YouTube
NFL
Nordstrom
Wal-Mart
Twitter
You will learn to install Python and Ruby. You'll learn how to download what you web scrape into CSV files and with Python you will learn how to put your data into a database.
Other lessons include how to get around obstacles such as websites with ajax that load content dynamically. You'll also learn how to crawl multiple pages of websites and get all the data you need!
With Import. io you will learn how to download a website that has over 40,000 products on it. Yes, 40,000 products and you will learn how to scrape all of those products.
Stop imagining you can grab data off websites and use them for your next web project, you an do it now.
Please note: Software installation can be done for both Mac OSX and Windows. I use a Mac so it is more focused on OSX however instructions are available for Windows.
Enroll now!
What are the requirements?
How to install software on their computer
Be able to understand a reasonable level of programming -- much of it will be explained
Follow step-by-step instructions
What am I going to get from this course?
Over 34 lectures and 3.5 hours of content!
Scrape a variety of websites
Scrape websites with Ruby
Scrape websites with Python
Scrape websites with Import. io
What is the target audience?
Anyone who has an interest or idea where they want to utilized data from other websites

Section 1: Course Introduction Lecture 1 Introduction: What you will learn 01:30 YES you will learn to scrape websites! And no, you don't need to be a highly skilled developer! Section 2: Import.io - Free, Easy to use software built for scraping websites Lecture 2 Import.io overview: learn how to install and get up and running 00:33 Lecture 3 Oh, it's kind of Magic: Grab products from IKEA 02:12 Lecture 4 Scrape Wikipedia Data and Map it 05:29 Scrape Wikipedia and map the data. Added August 28, 2015 Lecture 5 Learn how to Extract data from IMDB 04:09 Lecture 6 Extract data from Macys.com 04:51 Lecture 7 Yelp: Learn how to scrape information from Yelp! 04:50 Lecture 8 Yelp Advanced: Scrape the Top 100+ Pizza places in New York City 08:03 Lecture 9 Yelp: Learn how to Search and scrape Yelp results with an automated process! 08:11 Lecture 10 Learn how to crawl an entire website and capture over 40k products! 06:26 Lecture 11 From Import.io to Google Sheets. Get it into the cloud! 02:19 Lecture 12 BONUS: How to extract specific data - Zip Codes in Yelp 03:08 Learn how to extract a zip code from Yelp Section 3: Ruby - Don't know Ruby? It doesn't matter because you will soon! Lecture 13 Learn how to Install and Setup Ruby 01:48 Lecture 14 Simple Script: Learn How to Scrape Macys.com products 12:20 Lecture 15 Next Step: Macys.com getting a bit more advanced as we build your skills 04:11 Lecture 16 CSV: Now you have Macys.com data learn how to put it into a CSV file 04:41 Lecture 17 Walmart: How to scrape all pages from a product category on Walmart.com 07:55 Lecture 18 Spoof a site and look like you are web browser! 02:27 Lecture 19 Google + Mechanize = How to scrape search results from Google with Mechanize 04:32 Lecture 20 BONUS: Scraping YouTube's Most Popular 04:53 Lecture 21 BONUS: Scraping Zillow by Zip Code 06:44 Lecture 22 BONUS: Using JSON to scrape Walmart's website 08:58 Section 4: Python - Don't know Python? It doesn't matter because you will soon! Lecture 23 Installing and setting up Python 08:02 Lecture 24 Simple Script: Learn how to crawl IMDB 15:07 Lecture 25 Learn how to submit a web form 06:15 Lecture 26 Install Selenium and PhantomJS - Trust me you'll want these! 03:31 Lecture 27 Yes, you can crawl JavaScript! Learn to scrape Ajax with Selenium 11:36 Lecture 28 Simple: Crawl and export data from Nordstrom.com into a CSV 06:00 Lecture 29 Next Step: Crawl NFL data - Grab all the QB data from 2014! 09:20 Lecture 30 Advanced: Export NFL QB data to a CSV 05:39 Lecture 31 Export Data to MySQL 16:27 Section 5: Bonus: Ruby - How to Scrape via Twitter API Lecture 32 Scrape a Tweets from another User or Users 13:09 Lecture 33 Scrape Twitter searches for keywords and anyone who has tweeted using that keyw 06:08 Lecture 34 Take the scraped users and follow them or swap out for another username 05:04

حجم فایل: 834MB

آیا این نوشته را دوست داشتید؟
Udemy Web Scraping with Python Ruby And import. io for fun And profit

پیشنهاد فرادرس

سیامک در 1394/08/07 ساعت 10:40

سلام من این فایل رو دانلود کردم موقع اکسترکت کردن مشکل براش پیش میاد و یه سری ارور میده ، گزینه repair نداشت !
و موقعی که کامل اکسترکت شد حجمش شده بود 560 مگابایت ! الان که دانلود کردم 800 مگابایته بعد از اکسترکت شده 560!
ممنون از سایت خوبتون