Inicio Explorar Axuda
Rexistro Iniciar sesión
luojiehua
/
ContentExtract
1
0
Fork 0
Ficheiros Incidencias 0 Pull Requests 0 Wiki
Rama: master
Ramas Etiquetas
ContentExtract
/
module
/
listpage
/
test.log

test.log 5.2 KB
Permalink Histórico Raw

12345678910111213141516171819 
  1. 2019-11-15 10:16:33,542 INFO killing all webdrivers [_handle_fromlist() --> _call_with_frames_removed() --> _find_and_load() --> _find_and_load_unlocked() --> _load_unlocked() --> exec_module() --> _call_with_frames_removed() --> <module>() --> _find_and_load() --> _find_and_load_unlocked() --> _load_unlocked() --> exec_module() --> _call_with_frames_removed() --> <module>() --> initQueue() --> killAllDriver() --> log("killing all webdrivers")]
    2. 

  2. 2019-11-15 10:17:01,059 INFO the content_xpath of listpage is //*[@class="yaowen_list"] [getRule_listpage(listpage_url) --> log("the content_xpath of listpage is "+str(content_xpath))]
    3. 

  3. 2019-11-15 10:17:01,736 INFO xpath of a:	//*[@class="yaowen_list"]/li[1]/a[1]-[1] [getRule_listpage(listpage_url) --> getRule_A_Date(listpage_url,content_xpath) --> log("xpath of a:\t"+str(list_a[1][0])+"-"+str(list_a[0]))]
    4. 

  4. 2019-11-15 10:17:01,738 INFO xpath of date:	//*[@class="yaowen_list"]/li[1]/span[1]-[1] [getRule_listpage(listpage_url) --> getRule_A_Date(listpage_url,content_xpath) --> log("xpath of date:\t"+str(list_date[1][0])+"-"+str(list_date[0]))]
    5. 

  5. 2019-11-15 10:17:01,740 INFO length of A and Date:20-20 [getRule_listpage(listpage_url) --> getRule_A_Date(listpage_url,content_xpath) --> log("length of A and Date:"+str(len(list_a[1]))+"-"+str(len(list_date[1])))]
    6. 

  6. 2019-11-15 10:17:04,108 INFO click next bt:[True, ['/[共\\/]\\s*(\\d+)\\s*页|\\d+\\s*\\/\\s*(\\d+)|\\.{2}\\s*(\\d+)/', None, None], ['//*[@class="headStyle145a8rht89"]/tbody[1]/tr[1]/td[2]/div[1]/a[1]', 'a:contains(下页)']] [getRule_listpage(listpage_url) --> getTurnRule(browser,listpage_url) --> log("click next bt:"+str(click_next_1))]
    7. 

  7. 2019-11-15 10:17:05,646 INFO click next bt:[True, ['/[共\\/]\\s*(\\d+)\\s*页|\\d+\\s*\\/\\s*(\\d+)|\\.{2}\\s*(\\d+)/', None, None], ['//*[@class="headStyle1l3myfjtu6"]/tbody[1]/tr[1]/td[2]/div[1]/a[3]', 'a:contains(下页)']] [getRule_listpage(listpage_url) --> getTurnRule(browser,listpage_url) --> log("click next bt:"+str(click_next_2))]
    8. 

  8. 2019-11-15 10:17:05,655 INFO pageTurn first_url:	http://www.dp.gov.cn/dpxw/zwgz/gsgg/20.htm [getRule_listpage(listpage_url) --> getTurnRule(browser,listpage_url) --> getRuleOfUrl(url1, url2) --> log("pageTurn first_url:\t"+first_url)]
    9. 

  9. 2019-11-15 10:17:05,658 INFO pageTurn second_url:	http://www.dp.gov.cn/dpxw/zwgz/gsgg/19.htm [getRule_listpage(listpage_url) --> getTurnRule(browser,listpage_url) --> getRuleOfUrl(url1, url2) --> log("pageTurn second_url:\t"+second_url)]
    10. 

  10. 2019-11-15 10:37:31,081 INFO killing all webdrivers [_handle_fromlist() --> _call_with_frames_removed() --> _find_and_load() --> _find_and_load_unlocked() --> _load_unlocked() --> exec_module() --> _call_with_frames_removed() --> <module>() --> _find_and_load() --> _find_and_load_unlocked() --> _load_unlocked() --> exec_module() --> _call_with_frames_removed() --> <module>() --> initQueue() --> killAllDriver() --> log("killing all webdrivers")]
    11. 

  11. 2019-11-15 10:38:01,155 INFO the content_xpath of listpage is //*[@class="trad-sear-con"]/ul[1] [getRule_listpage(listpage_url) --> log("the content_xpath of listpage is "+str(content_xpath))]
    12. 

  12. 2019-11-15 10:38:01,937 INFO xpath of a:	//*[@class="trad-sear-con"]/ul[1]/li[1]/a[1]-[3] [getRule_listpage(listpage_url) --> getRule_A_Date(listpage_url,content_xpath) --> log("xpath of a:\t"+str(list_a[1][0])+"-"+str(list_a[0]))]
    13. 

  13. 2019-11-15 10:38:01,939 INFO xpath of date:	//*[@class="trad-sear-con"]/ul[1]/li[1]/span[1]-[3] [getRule_listpage(listpage_url) --> getRule_A_Date(listpage_url,content_xpath) --> log("xpath of date:\t"+str(list_date[1][0])+"-"+str(list_date[0]))]
    14. 

  14. 2019-11-15 10:38:01,941 INFO length of A and Date:20-20 [getRule_listpage(listpage_url) --> getRule_A_Date(listpage_url,content_xpath) --> log("length of A and Date:"+str(len(list_a[1]))+"-"+str(len(list_date[1])))]
    15. 

  15. 2019-11-15 10:38:09,027 INFO click next bt:[True, ['/[共\\/]\\s*(\\d+)\\s*页|\\d+\\s*\\/\\s*(\\d+)|\\.{2}\\s*(\\d+)/', None, None], [None, None]] [getRule_listpage(listpage_url) --> getTurnRule(browser,listpage_url) --> log("click next bt:"+str(click_next_1))]
    16. 

  16. 2019-11-15 10:38:15,103 INFO click next bt:[True, ['/[共\\/]\\s*(\\d+)\\s*页|\\d+\\s*\\/\\s*(\\d+)|\\.{2}\\s*(\\d+)/', None, None], [None, None]] [getRule_listpage(listpage_url) --> getTurnRule(browser,listpage_url) --> log("click next bt:"+str(click_next_2))]
    17. 

  17. 2019-11-15 10:38:15,117 INFO pageTurn first_url:	http://www.qyggfw.cn/w/bid/qualiInqueryResult/morePageList?filterparam=%7B%22assortment%22%3A%223%22%2C%22areaCode%22%3A%22621000%22%2C%22workNotice%22%3A%7B%22noticeNature%22%3A%221%22%2C%22bulletinType%22%3A%221%22%7D%7D [getRule_listpage(listpage_url) --> getTurnRule(browser,listpage_url) --> getRuleOfUrl(url1, url2) --> log("pageTurn first_url:\t"+first_url)]
    18. 

  18. 2019-11-15 10:38:15,121 INFO pageTurn second_url:	http://www.qyggfw.cn/w/bid/qualiInqueryResult/morePageList?filterparam=%7B%22assortment%22%3A%223%22%2C%22areaCode%22%3A%22621000%22%2C%22workNotice%22%3A%7B%22noticeNature%22%3A%221%22%2C%22bulletinType%22%3A%221%22%7D%7D [getRule_listpage(listpage_url) --> getTurnRule(browser,listpage_url) --> getRuleOfUrl(url1, url2) --> log("pageTurn second_url:\t"+second_url)]
    19. 

  19. 2019-11-15 10:38:15,123 ERROR expected string or bytes-like object [getRule_listpage(listpage_url) --> getRecognize_detail_listpage(list_listpage_url, list_hrefs) --> error(str(e))]
    20.