Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

support peer reviews & other utility changes #142

Open
wants to merge 19 commits into
base: master
Choose a base branch
from
Open

support peer reviews & other utility changes #142

wants to merge 19 commits into from

Conversation

x-j
Copy link

@x-j x-j commented Jul 24, 2022

  • added various functions to Article class, among them: obtaining keywords, sub-articles, from_xml constructor
  • additional parameters to allow for not unzipping the corpus after downloading from gdrive
  • update plos_page_dict and various regex to allow links to pages containing peerReviews
  • other small changes including e.g. switching to os.path.join in tests

x-j and others added 17 commits April 1, 2022 15:07
add get_subarticles to Article
17dc400
from_xml constructor for Articles
553ec35 
takes an XML string as input
refactor body property
cb4445f
extend validating urls to include peer reviews
35a6df6 
modify and rename validate_url to accept supplementary materials
add option to not unzip, keeping zip file instead
115fba2
add parameters to create_local_plos_corpus
c10be09
fix from_xml article constructor
8d33d63
add functions to article class
982d358 
self.categories and self.get_author_names()
add comments
ee96a67
get_page handles reviews
cadff26
get_page now handles reviews
e2d3c31
add peerReviews to plos_page_dict
7d2fa18
peerReviews -> peerReview
f01530b
add peerReview to plos_page_dict
4e847da
Merge branch 'crawling' of https://github.com/x-j/allofplos into craw…
596af59 
…ling
Merge branch 'master' into crawling
3b1982d
change to os-universal paths
63e1a7f
@x-j x-j changed the title support peer revies & other utility changes support peer reviews & other utility changes Aug 1, 2022
@x-j x-j mentioned this pull request Aug 1, 2022
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@x-j