Web Scraping with Python: Data Extraction from the Modern Web 3/e

Mitchell, Ryan

  • 出版商: O'Reilly
  • 出版日期: 2024-03-26
  • 售價: $2,360
  • 貴賓價: 9.5$2,242
  • 語言: 英文
  • 頁數: 336
  • 裝訂: Quality Paper - also called trade paper
  • ISBN: 1098145356
  • ISBN-13: 9781098145354
  • 相關分類: Python程式語言Web-crawler 網路爬蟲
  • 海外代購書籍(需單獨結帳)

買這商品的人也買了...

商品描述

If programming is magic, then web scraping is surely a form of wizardry. By writing a simple automated program, you can query web servers, request data, and parse it to extract the information you need. This thoroughly updated third edition not only introduces you to web scraping but also serves as a comprehensive guide to scraping almost every type of data from the modern web.

Part I focuses on web scraping mechanics: using Python to request information from a web server, performing basic handling of the server's response, and interacting with sites in an automated fashion. Part II explores a variety of more specific tools and applications to fit any web scraping scenario you're likely to encounter.

  • Parse complicated HTML pages
  • Develop crawlers with the Scrapy framework
  • Learn methods to store the data you scrape
  • Read and extract data from documents
  • Clean and normalize badly formatted data
  • Read and write natural languages
  • Crawl through forms and logins
  • Scrape JavaScript and crawl through APIs
  • Use and write image-to-text software
  • Avoid scraping traps and bot blockers
  • Use scrapers to test your website

商品描述(中文翻譯)

如果編程是魔法,那麼網絡爬蟲無疑是一種巫術。通過編寫一個簡單的自動化程序,您可以查詢網絡服務器,請求數據並解析它以提取所需的信息。這本全面更新的第三版不僅介紹了網絡爬蟲,還作為一本從現代網絡中爬取幾乎所有類型數據的綜合指南。

第一部分專注於網絡爬蟲的機制:使用Python從網絡服務器請求信息,對服務器的響應進行基本處理,並以自動化方式與網站進行交互。第二部分探索了各種更具體的工具和應用,以滿足您可能遇到的任何網絡爬蟲場景。

- 解析複雜的HTML頁面
- 使用Scrapy框架開發爬蟲
- 學習存儲爬取數據的方法
- 讀取並從文檔中提取數據
- 清理和規範格式錯誤的數據
- 讀寫自然語言
- 通過表單和登錄進行爬行
- 爬取JavaScript並通過API進行爬行
- 使用和編寫圖像轉文本軟件
- 避免爬蟲陷阱和機器人阻擋
- 使用爬蟲測試您的網站