作者查詢 / aidansky0989
作者 aidansky0989 在 PTT [ Python ] 看板的留言(推文), 共125則
限定看板:Python
看板排序:
全部Gossiping5363Hearthstone2979Boy-Girl2633HatePolitics2157WomenTalk1295sex914Salary760Soft_Job622nb-shopping423movie407fastfood317CVS212Insurance194JinYong188MAC157AllTogether148C_Chat136marriage126Python125Stock124Militarylife123CATCH119MobilePay88Lifeismoney86feminine_sex54Wanted28nCoV201925DataScience24MacShop22part-time19Tech_Job18java15HomeTeach14joke11PC_Shopping11Beauty10AHQ7Ahqwestdoor7job7StupidClown7home-sale6iOS6NEW_ROC6TaichungBun6Eng-Class5FITNESS5forsale5Examination4FlashWolves4SENIORHIGH4Teacher4HardwareSale3Tainan3cookclub2hypermall2japanavgirls2juniorhigh2L_FoodAndDri2L_TalkandCha2PttNewhand2Taoyuan2TKU_EE_92C2WFSH2AfterPhD1Bank_Service1BlizzHeroes1Brethren1CCRomance1China_Travel1ComGame-Plan1Database1dog1e-shopping1einvoice1Food1give1graduate1Hip-Hop1JD_Lover1L_BoyMeetsGi1Libra1medstudent1mobilesales1Oversea_Job1OverWatch1PhD1Violation1WOW1<< 收起看板(88)
1F推: 推晚點研究一下05/10 09:01
2F推: 我昨天爬ubereats是用cookie,裡面有QLoc之類的cook05/09 18:21
3F→: ies,ˊ真的沒想法從網址下手也可05/09 18:21
4F→: 不過爬蟲本來就要花時間摸網頁結構,直接開selenium05/09 18:24
5F→: 萬解也可05/09 18:24
1F推: fig=figure(5,5)05/05 14:34
2F→: ax1=plt.subplot(1,2,1)05/05 14:34
3F→: ax2=plt.subplot(1,2,2)05/05 14:34
4F→: 試試,我猜是這樣05/05 14:34
5F→: fig=plt.figure才對05/05 14:34
2F→: 遇到的問題是1.預計爬20頁資料,實際只爬出2-3頁的04/29 23:30
3F→: 資料量2.約第100筆以後的資料是投毒返回,價格返回04/29 23:30
4F→: 亂數,店家地址只返回第一個字,圖片網址亂碼。前1004/29 23:30
5F→: 0筆搜尋驗證過資料數值都正確04/29 23:30
6F→: 過一段時間再爬又可以爬出約100筆正確資料,推測可04/29 23:36
7F→: 能是cookies時效已過被清除。電腦試過改用代理IP,04/29 23:36
8F→: 換過多個代理IP都無法連線04/29 23:36
10F→: user-agent有設,放在headers04/30 17:44
6F→: 不要開瀏覽器,很沒效率04/29 21:36
7F→: 問google大神會有答案04/29 21:38