selenium - Scraping Webpage using Python -


im using selenium access school grades , after want able scrape grades site dont know how

here login code:

from selenium import webdriver selenium.webdriver.common.keys import keys  driver = webdriver.phantomjs("c:\python27\phantomjs-1.9.0-windows\phantomjs.exe")  driver.get("https://ps.rsd.edu/public/")  elem = driver.find_element_by_name("account") elem.send_keys("username") elem2 = driver.find_element_by_name("pw") elem2.send_keys("password") elem.send_keys(keys.return)  driver.quit()  print "done" 

i think easiest way use beautifulsoup im not sure

i'll answer here other question how parse table using beautifulsoup.

so given table @ http://gist.github.com/c-dubb/5522909

for cell in driver.find_elements_by_css_selector(".grid tr a[href$='fg=s2']"):     print cell.text     # if want number only, need strip grades here     # need check if s2 cell empty or not 

Comments