用Python爬取LOL所有的英雄信息以及英雄皮膚的示例代碼

更新時間：2020年07月13日 09:54:39 作者：阿壯Jonsson

這篇文章主要介紹了用Python爬取LOL所有的英雄信息以及英雄皮膚的示例代碼，主要分為兩部分，獲取網(wǎng)頁上數(shù)據(jù)和圖片保存到本地等，感興趣的可以了解一下

實現(xiàn)思路：分為兩部分，第一部分，獲取網(wǎng)頁上數(shù)據(jù)并使用xlwt生成excel（當然你也可以選擇保存到數(shù)據(jù)庫），第二部分獲取網(wǎng)頁數(shù)據(jù)使用IO流將圖片保存到本地

一、爬取所有英雄屬性并生成excel

1.代碼

import json

import requests
import xlwt

# 設(shè)置頭部信息，防止被檢測出是爬蟲
headers = {
 'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.116 Safari/537.36'
}
url = "https://game.gtimg.cn/images/lol/act/img/js/heroList/hero_list.js"
response = requests.get(url=url, headers=headers).text
loads = json.loads(response)
dic = loads['hero']
# 創(chuàng)建一個workbook 設(shè)置編碼
workbook = xlwt.Workbook(encoding='utf-8')
# 創(chuàng)建一個worksheet
worksheet = workbook.add_sheet('LOL')
try:
 for i in range(len(dic)):
  # 設(shè)置單元格寬度大小
  worksheet.col(i).width = 4000
  # 設(shè)置單元格高度大小
  style = xlwt.easyxf('font:height 300')
  worksheet.row(i).set_style(style)
  # 第一行用于寫入表頭
  if i == 0:
   worksheet.write(i, 0, '編號')
   worksheet.write(i, 1, '名稱')
   worksheet.write(i, 2, '英文名')
   worksheet.write(i, 3, '中文名')
   worksheet.write(i, 4, '角色')
   worksheet.write(i, 5, '物攻')
   worksheet.write(i, 6, '物防')
   worksheet.write(i, 7, '魔攻')
   worksheet.write(i, 8, '魔防')
   continue
  worksheet.write(i, 0, dic[i - 1]['heroId'])
  worksheet.write(i, 1, dic[i - 1]['name'])
  worksheet.write(i, 2, dic[i - 1]['alias'])
  worksheet.write(i, 3, dic[i - 1]['title'])
  roles_ = dic[i - 1]['roles']
  roles = []
  for data in roles_:
   if 'mage' == data:
    roles.append('法師')
   if 'tank' == data:
    roles.append('坦克')
   if 'fighter' == data:
    roles.append('戰(zhàn)士')
   if 'marksman' == data:
    roles.append('ADC')
   if 'assassin' == data:
    roles.append('刺客')
   if 'support' == data:
    roles.append('輔助')
  worksheet.write(i, 4, str(roles))
  worksheet.write(i, 5, dic[i - 1]['attack'])
  worksheet.write(i, 6, dic[i - 1]['defense'])
  worksheet.write(i, 7, dic[i - 1]['magic'])
  worksheet.write(i, 8, dic[i - 1]['difficulty'])
  # 保存
 workbook.save('C:\\Users\\Jonsson\\Desktop\\lol.xls')
except Exception as e:
 print(e)

2.效果

二、爬取所有英雄皮膚并保存到本地

1.代碼

import json
import os

import requests
import xlwt

# 設(shè)置頭部信息，防止被檢測出是爬蟲
headers = {
 'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.116 Safari/537.36'
}
url = "https://game.gtimg.cn/images/lol/act/img/js/heroList/hero_list.js"
# 請求英雄列表的url地址
response = requests.get(url=url, headers=headers).text
loads = json.loads(response)
dic = loads['hero']
for data in dic:
 id_ = data['heroId']
 skinUrl = 'https://game.gtimg.cn/images/lol/act/img/js/hero/%s.js' % id_
 # 請求每個英雄皮膚的url地址
 skinResponse = requests.get(url=skinUrl, headers=headers).text
 json_loads = json.loads(skinResponse)
 hero_ = json_loads['hero']
 save_path = './skin/%s-%s-%s' % (hero_["heroId"], hero_['name'], hero_['title'])
 # 文件夾不存在，則創(chuàng)建文件夾
 folder = os.path.exists(save_path)
 if not folder:
  os.makedirs(save_path)
 skins_ = json_loads['skins']
 for data in skins_:
  if data['chromas'] == '0':
   content = requests.get(url=data['mainImg'], headers=headers).content
   try:
    with open('%s/%s.jpg' % (save_path, data['name']), "wb") as f:
     print("正在下載英雄：%s 皮膚名稱：%s ..." % (hero_['name'], data['name']))
     f.write(content)
   except Exception as e:
    print('下載失敗')
    print(e)

2.效果