I get an error message when trying to run this script!!

[ebamgithub]

I get an error message when trying to run this script!!

[chudnov]

Please elaborate on the issue...

[ebamgithub]

Ok will elaborate, and try to post a screenshot of the message if that helps...(give me a couple of hours).

[ebamgithub]

I decided the best way to explain is to say Bs4 isn't working and I will upload a video here of me trying to run the script ( as I am a bit of a noob).

https://youtu.be/wzqPnY5oV18

Here is the link to the video screenshot of me trying to operate it,

[ebamgithub]

Actually I got selenium running Now:

I get Traceback (most recent call last):
File "C:\Users\ebam_\AppData\Local\Programs\Python\Python37\lib\multiprocessing\process.py", line 297, in bootstrap
self.run()
File "C:\Users\ebam\AppData\Local\Programs\Python\Python37\lib\multiprocessing\process.py", line 99, in run
self.target(*self.args, **self.kwargs)
File "C:\Users\ebam\AppData\Local\Programs\Python\Python36-32\EB-test-scripts\costco-scrape-master\costco-scrape-master\scrape.py", line 153, in run
load_data(driver)
File "C:\Users\ebam\AppData\Local\Programs\Python\Python36-32\EB-test-scripts\costco-scrape-master\costco-scrape-master\scrape.py", line 43, in load_data
extract_and_load_all_data(soup)
File "C:\Users\ebam\AppData\Local\Programs\Python\Python36-32\EB-test-scripts\costco-scrape-master\costco-scrape-master\scrape.py", line 130, in extract_and_load_all_data
"Meta tags": get_meta_tags(soup),
File "C:\Users\ebam_\AppData\Local\Programs\Python\Python36-32\EB-test-scripts\costco-scrape-master\costco-scrape-master\scrape.py", line 61, in get_meta_tags
meta_tags = [tags.get('name') + " is " + tags.get('content') for tags in soup.find_all('meta')[3:8]]
File "C:\Users\ebam_\AppData\Local\Programs\Python\Python36-32\EB-test-scripts\costco-scrape-master\costco-scrape-master\scrape.py", line 61, in
meta_tags = [tags.get('name') + " is " + tags.get('content') for tags in soup.find_all('meta')[3:8]]
TypeError: unsupported operand type(s) for +: 'NoneType' and 'str'

as an error message. I will upload the second video of my correction ( i was making a mistake when running the file initially as shown in the first video...

( This is the actual error i had yesterday).

[ebamgithub]

https://youtu.be/QonhNDoU2e0

here is the video of me attempting it, as we can see selenium loads but some error occurs.

[chudnov]

Costco most likely changed the format of their website since I last wrote the code. This completely breaks the script.

[ebamgithub]

When exactly did you write this script and what is the logic behind it so I can rewrite it and get a scraper , ideally for me I want to know how to rewrite it so it’s workable as I want to know how to build a similar scraper for different website ( the overall logic is what I am interested in). Emmanuel

…

Sent from my iPhone On 6 Mar 2019, at 01:44, Jacob Chudnovsky <[email protected]<mailto:[email protected]>> wrote: Costco most likely changed the format of their website since I last wrote the code. This completely breaks the script. — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub<#1 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/AkzYAodygDro2W3h_KPmBhAahglnCwxDks5vTx19gaJpZM4bdQ2->.

[chudnov]

I finished writing it Jul 16, 2018. The logic is simply to use Selenium as a webdriver, and then use beautifulsoup to access the html tags of the page for the exact values that you want (will differ for every page). Thats it!

[ebamgithub]

U made it sound so simple to make!

…

________________________________ From: Jacob Chudnovsky <[email protected]> Sent: Wednesday, 6 March 2019 05:27 To: odysseyjacob/costco-scrape Cc: ebamgithub; Author Subject: Re: [odysseyjacob/costco-scrape] I get an error message when trying to run this script!! (#1) I finished writing it Jul 16, 2018. The logic is simply to use Selenium as a webdriver, and then use beautifulsoup to access the html tags of the page for the exact values that you want (will differ for every page). Thats it! — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub<#1 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/AkzYAuPkiyZ3Jzkp_E5ijRTOpvkyzBOcks5vT1HDgaJpZM4bdQ2->.

[ebamgithub]

Hmmn I am struggling with this, do you use skype or discord or telegram and you could give me some hints about how to update the code coming from the perspective that I am a bit of a noob.