크롤링 중 데이터를 받아오지 못할 때.

크롤링 중 데이터를 받아오지 못할 때.

1. user-agent, referrer
2. cookies
3. auth, authorization 등 권한의미 포함 값
4. 전부 다

import json
import requests

url = 'https://comic.naver.com//comment/comment?titleId=783053&no=52'

# 1. user-agent, referrer
headers = {
	'User-Agent' : 'Mozilla/5.0 (Windows NT 10.0;Win64; x64)\AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.98\Safari/537.36'
    , 'referer': 'https://comic.naver.com//comment/comment?titleId=783053&no=52'

}

resp = requests.get(url, headers=headers)
resp.content

 

 

References

https://cceeddcc.tistory.com/5

파이썬(Python) 웹 크롤링 관련 : requests