selenium chromedriver web scrapper etf


from selenium import webdriver

import pandas as pd

import time



driver = webdriver.Chrome('./chromedriver')

symbol_df  = pd.DataFrame([])

for i in range(1,50):
    driver.get("https://google.com")
    time.sleep(1)
    driver.get("https://etfdb.com/screener/#page="+str(i))
    time.sleep(1)
    symbol_df = symbol_df.append( pd.DataFrame( pd.read_html(driver.page_source)[0]['Symbol'] )[:-1] )
    
    print(i)

symbol_df.reset_index( drop = True ).drop_duplicates().to_csv( 'list_etf.csv' )
                                                                                                                     

留言

發佈留言

此網誌的熱門文章

Making a Windows 11 hotspot without an internet connection

Making a Windows 11 hotspot without an internet connection Software Until now, I have been running my mount and cameras directly from a Windows 10 laptop. While that has worked fine, it has always meant needing to set up my laptop pretty near the telescope assembly to allow all the cables to connect. More importantly, it also means that I have to keep a Windows laptop around instead of my normal Linux daily driver. (I use a celestron mount and use CPWI). So, I finally decided to buy a small Windows mini-PC to run the mount and camera. I settled on a Mele Quieter3C mini-PC. My desire is to keep the equipment that I need to haul around with my setup to a minimum, so I wanted to avoid the need for any sort of router in the setup. Ideally, the mini-PC should host a hotspot that I can connect to and then use RDP to access the mini-PC. Sounds simple enough, except that it seems that Windows 11 doesn't have the ability to host a wireless network if it isn't sharing an already existing...
閱讀更多