requests.ConnectionError 网络连接错误异常,如DNS查失、拒绝连接等
requests.HTTPError HTTP错误异常
requests.URLRequired URL缺失异常
requests.TooManyRedirects 超过最大重定向次数,产生重定向异常
requests.ConnectTimeout 连接远程服务器超时异常
requests.Timeout 请求URL超时,产生超时异常

raise_for_status() 如果不是200,产生异常requests.HTTPError

爬虫通用代码框架
import requests
def getHTMLText(url):

  try:
       r = requests.get(url,timeout=30)
       r.raise_for_status()
       r.encoding = r.apparent_encoding
       return r.text
  except:
       return "产生异常"

if name == "__main__":

  url = "http://www.baidu.com"
  print(getHTMLText(url))

标签: none

添加新评论