Sfoglia il codice sorgente

附件文本无法识别的问题

luojiehua 3 anni fa
parent
commit
4c4e85637a
2 ha cambiato i file con 5 aggiunte e 3 eliminazioni
  1. 1 0
      BiddingKG/dl/interface/Preprocessing.py
  2. 4 3
      BiddingKG/dl/test/test4.py

+ 1 - 0
BiddingKG/dl/interface/Preprocessing.py

@@ -1464,6 +1464,7 @@ def get_preprocessed_article(articles,cost_time = dict(),useselffool=True):
     for article in articles:
         doc_id = article[0]
         sourceContent = article[1]
+        sourceContent = re.sub("<html>|</html>|<body>|</body>","",sourceContent)
         _send_doc_id = article[3]
         _title = article[4]
         #表格处理

File diff suppressed because it is too large
+ 4 - 3
BiddingKG/dl/test/test4.py


Some files were not shown because too many files changed in this diff