Spaces:

Oxbridge-Economics
/

Data-Collection-China

Running

OxbridgeEconomics commited on Apr 21, 2024

Commit

b37fb00

1 Parent(s): 57808eb

commit

Files changed (1) hide show

utils.py CHANGED Viewed

@@ -183,6 +183,7 @@ def crawl(url, article):
     article['attachment'] = ""
     article['sentimentScore'], article['sentimentLabel'] = sentiment_computation(CONTENT_ENG.replace("\n",""))
     article['id'] = uuid.uuid5(uuid.NAMESPACE_OID, article['titleCN']+article['publishDate'])
     update_content(article)
 def upsert_content(report):

     article['attachment'] = ""
     article['sentimentScore'], article['sentimentLabel'] = sentiment_computation(CONTENT_ENG.replace("\n",""))
     article['id'] = uuid.uuid5(uuid.NAMESPACE_OID, article['titleCN']+article['publishDate'])
+    print(article['id'], article['site'] )
     update_content(article)
 def upsert_content(report):