ROUGE metrics

Author: chrisatang

data/tmp/000086.txt

@@ -0,0 +1,56 @@
+instructions how to enable JavaScript in your web browser.
+Scope of the ServiceThe Service provides you with the ability to add, create, upload, submit, distribute, or post ("submit", "submitting", or "submission") content, articles, data, text, photographs, images, illustrations, or other information on or to the Service (collectively, the "Member Submissions").
+By way of example, and not as a limitation, Member Submissions may be submitted when you request the Service to (i) identify, resolve, copy, or import content stored on your or a third party’s computer system, (ii) synchronize content such that the Service stores or "mirrors" content stored on your or a third party’s computer system by storing such content on equipment owned or operated by ResearchGate, (iii) save or store your comments, edits, or annotations to content accessible through the Service, or (iv) share with another person any content stored on your or a third party’s computer system.
+You may not accept, adopt, or post content that falsely or misleadingly implies an incorrect identity, inaccurate biographical facts, or misleading information about your qualifications, work experience, or achievements.
+You are obliged to update such data when it changes.
+If you choose to use a profile photo, you must use a photo where you can be clearly identified; images of other people, animals, text, and logos are not permitted.
+You are responsible to ensure that the use or other exploitation of any Member Submissions by you as contemplated by these Terms does not infringe or violate the rights of any third party, including without limitation any privacy rights, publicity rights, patent, copyrights, contract rights, or any other intellectual property or proprietary rights.
+Except in the case of Member Submissions containing content exclusively in the public domain, you represent and warrant, and can demonstrate to our full satisfaction upon request that (i) you own or otherwise control any and all rights or licenses required in order to submit or share all content in your Member Submissions and you consent to the use of such content as contemplated by these Terms, and (ii) you have full authority to act on behalf of any and all owners of any right, title, or interest in and to any content in your Member Submissions to use such content as contemplated by these Terms.
+We will not be liable for any errors or omissions in any content.
+When necessary and/or appropriate, as when another User reports inappropriate content to us, we may delete, modify, or reformat any materials, content, or information submitted by you.
+If you have chosen to make your information publicly available, you understand that Member Submissions may be shared with third parties in connection with your use of the Service, and that we cannot and do not control any such third parties.
+For further information, please refer to our Privacy Policy.
+If you are under 18, you may not use or attempt to register for the Service.
+You are obliged to keep your password to access the Service secret.
+ResearchGate will not disclose your password to any third party, shall only use it during the login process, and shall not ask for your password at any time other than during the login process.
+For security reasons and to prevent misuse, we recommend that you change your password at regular intervals.
+You are solely responsible for anything that happens through your account, unless you close it or report misuse.
+Information made available within the Service is not to be monetized.
+You must not store, process, or use any other User's Personal Information for any other purpose than the natural purpose of such data being published within the Service by the respective User.
+In connection with using or accessing the Service, you shall not:---Post false, inaccurate, dishonest, misleading, deceptive, defamatory, or libelous content, regardless of the person or entity to whom it is directed;---Use the Service to annoy, harass, abuse, insult, personally attack, or send other unwelcome communications to others (including to ResearchGate), including but not limited to junk mail, offers to buy or sell, spam, chain letters, phishing schemes, and excessive messages (cf.
+Section 7 of the German Unfair Competition Act –
+UWG);---Post Personal Information about another person (e.g.
+an email address or phone number), confidential or proprietary information, or any information
+you do not have a right to publish;---Post content which constitutes hate speech, including, but not limited to, that which attacks people based on their race, ethnicity, national origin, political or religious affiliation, sexual orientation, sex, gender, gender identity, age, or serious disabilities or diseases;---Post or promote any pornographic, intimidating, abusive, shocking, immoral, sexually inappropriate, or violence-glorifying materials or any content that violates any applicable legislation for the protection of minors or communicates in any sexually explicit or suggestive way;---Transfer your ResearchGate account to another party without our consent, or operate an account under a false name or identity;---Distribute or promote advertising or commercial promotional content, or send unsolicited advertising, job offers, or business proposals;---Commercialize any ResearchGate application or any information or software associated with such application, except with the prior express permission of ResearchGate in writing;---Post requests for unauthorized copyrighted material (e.g.
+software, books, publications) or "pirated" or "cracked" versions of software;---Post content whose primary purpose is to drive Users to links outside of ResearchGate;---Act dishonestly or unprofessionally, including by posting broad, vague, or non-scientific content, or by misusing the Service and its features;---Intentionally infect others with viruses, worms, or other software that can destroy, interrupt, or collect their data or computer devices;---Post excessively within a short timeframe, interfere with the working of our Service, or impose an unreasonable or disproportionately large load on our infrastructure;---Impose an unreasonable or disproportionately large administrative burden on ResearchGate;---Use any robot, spider, scraper, data mining tools, data gathering and extraction tools, or other automated means to access our Service for any purpose, except with the prior express permission of ResearchGate in writing;---Employ any mechanisms, software, or scripts when using the Service;---Block, overwrite, modify, or copy any contents of the Service, unless said actions are necessary for the proper use of ResearchGate; or---Encourage or enable any other individual to do any of the foregoing.5.
+Copyright and other intellectual property rightsThe software running the Service, the site design and content, the logos and other graphics, articles and other texts, as well as the database are protected by copyright, trademark, and other intellectual property laws in multiple jurisdictions.
+Changes to the ServiceWe reserve the right to modify the Service or to offer services different from those offered at the time of the User’s registration at any time, in particular under, but not limited to, the following circumstances:---We introduce new features that enhance the Service;---To the extent we are required in order to comply with applicable law, including in the event of a change in such laws;---To the extent we are required to do so because of a legal order or decision by a government authority;---To the extent the respective modifications are required to mitigate any potential security
+Unless stated otherwise, new terms shall be effective thirty days from the date of such notice.
+You are obliged to check your account regularly for a notice about changes to these Terms.
+the extent we are obliged to do so because of a judgment or decision by the authorities; or---To the extent we introduce supplementary, completely new services, or service components requiring a service description in the Terms, unless this has a detrimental impact on the use relationship to date.10.
+Term, TerminationYou may terminate the contractual relationship at any time without cause by simply disabling or deleting your account.
+Apart from the cases set out above, ResearchGate’s liability shall be limited to typical foreseeable contractual damages in the event of a breach of any of its cardinal contractual duties due to slight negligence.
+Cardinal contractual duties are an abstract description of those obligations whose fulfilment is indispensable for the proper implementation of an agreement and on whose fulfilment the contracting parties can usually rely.
+This does not apply if the User is a consumer in the sense of Article 17 of EU Regulation
+1215/2012 and is residing in a Member State of the EU; in this case the international jurisdiction is governed by Article 18 of EU Regulation
+We do not represent or warrant that the Service and the data and information provided are accurate, up-to-date, complete, or reliable.
+We are not responsible or liable for any damage, disadvantage, or loss of profit, whether material or immaterial, that is caused by the usage or non-usage of the Service.
+Accordingly, neither of us may start a formal proceeding (except for Claims described in the "Exceptions" section below) for at least 30 days after one of us notifies the other of a Claim in writing.
+You will send your notice by email to copyright@researchgate.net
+20, 10115 Berlin, Germany.
+We will send your notice by email to the email address associated with your account.
+Notwithstanding the foregoing, the notice and 30-day negotiation period required by this paragraph shall not apply, however, to disputes, claims, or controversies concerning patents, copyrights, moral rights, trademarks, and trade secrets and claims of piracy or unauthorized use of the Service.
+Except as provided in the "Exceptions" section below, if we cannot resolve a Claim informally, any Claim either of us asserts will be resolved only by binding arbitration and not in courts of general jurisdiction.
+If there is a conflict between JAMS Rules and the rules set forth in these Terms, the rules set forth in these Terms will govern.
+THAT
+YOU WAIVE YOUR RIGHT TO A JURY TRIAL.
+You may, in arbitration, seek any and all remedies otherwise available to you pursuant to your state’s law.
+We also agree to pay the costs of the arbitration proceeding.
+To start an arbitration, you or we must do the following things:---Write a Demand for Arbitration.
+You also agree to pay the costs of the arbitration proceeding.
+§ 2510-2521, or any other statement or law governing theft of service, shall not be subject to arbitration as set out in this Section 17 and may be decided only by a court of competent jurisdiction.
+Moreover, you may choose to pursue your claim in small claims court where jurisdiction and venue over ResearchGate and you otherwise qualify for such small claims court and where your claim does not include a request for any type of equitable relief.
+If you are a Personal User, you have the right to opt out and not be bound by the binding arbitration requirement by sending written notice of your decision to opt out to the email address copyright@researchgate.net.
+If you opt out of the binding arbitration requirement, we also will not be bound by the requirement.
+Changes will become effective on the 30th day, and will apply prospectively only to any claims arising after the 30th day.18.
+You and ResearchGate both consent to venue and personal jurisdiction in San Francisco, California.

data/tmp_sys/000086.txt

@@ -0,0 +1,32 @@
+---------------------------------------------
+1 ROUGE-1 Average_R: 0.10219 (95%-conf.int. 0.10219 - 0.10219)
+1 ROUGE-1 Average_P: 0.92453 (95%-conf.int. 0.92453 - 0.92453)
+1 ROUGE-1 Average_F: 0.18404 (95%-conf.int. 0.18404 - 0.18404)
+---------------------------------------------
+1 ROUGE-2 Average_R: 0.08351 (95%-conf.int. 0.08351 - 0.08351)
+1 ROUGE-2 Average_P: 0.76190 (95%-conf.int. 0.76190 - 0.76190)
+1 ROUGE-2 Average_F: 0.15052 (95%-conf.int. 0.15052 - 0.15052)
+---------------------------------------------
+1 ROUGE-3 Average_R: 0.07419 (95%-conf.int. 0.07419 - 0.07419)
+1 ROUGE-3 Average_P: 0.68269 (95%-conf.int. 0.68269 - 0.68269)
+1 ROUGE-3 Average_F: 0.13384 (95%-conf.int. 0.13384 - 0.13384)
+---------------------------------------------
+1 ROUGE-4 Average_R: 0.06904 (95%-conf.int. 0.06904 - 0.06904)
+1 ROUGE-4 Average_P: 0.64078 (95%-conf.int. 0.64078 - 0.64078)
+1 ROUGE-4 Average_F: 0.12465 (95%-conf.int. 0.12465 - 0.12465)
+---------------------------------------------
+1 ROUGE-L Average_R: 0.09802 (95%-conf.int. 0.09802 - 0.09802)
+1 ROUGE-L Average_P: 0.88679 (95%-conf.int. 0.88679 - 0.88679)
+1 ROUGE-L Average_F: 0.17653 (95%-conf.int. 0.17653 - 0.17653)
+---------------------------------------------
+1 ROUGE-W-1.2 Average_R: 0.03468 (95%-conf.int. 0.03468 - 0.03468)
+1 ROUGE-W-1.2 Average_P: 0.63044 (95%-conf.int. 0.63044 - 0.63044)
+1 ROUGE-W-1.2 Average_F: 0.06574 (95%-conf.int. 0.06574 - 0.06574)
+---------------------------------------------
+1 ROUGE-S* Average_R: 0.00984 (95%-conf.int. 0.00984 - 0.00984)
+1 ROUGE-S* Average_P: 0.81222 (95%-conf.int. 0.81222 - 0.81222)
+1 ROUGE-S* Average_F: 0.01944 (95%-conf.int. 0.01944 - 0.01944)
+---------------------------------------------
+1 ROUGE-SU* Average_R: 0.01003 (95%-conf.int. 0.01003 - 0.01003)
+1 ROUGE-SU* Average_P: 0.81429 (95%-conf.int. 0.81429 - 0.81429)
+1 ROUGE-SU* Average_F: 0.01982 (95%-conf.int. 0.01982 - 0.01982)

evaluation/Perceptron_rouge/amazon_ROUGE.txt

@@ -0,0 +1,32 @@
+---------------------------------------------
+1 ROUGE-1 Average_R: 0.01155 (95%-conf.int. 0.01155 - 0.01155)
+1 ROUGE-1 Average_P: 1.00000 (95%-conf.int. 1.00000 - 1.00000)
+1 ROUGE-1 Average_F: 0.02284 (95%-conf.int. 0.02284 - 0.02284)
+---------------------------------------------
+1 ROUGE-2 Average_R: 0.01055 (95%-conf.int. 0.01055 - 0.01055)
+1 ROUGE-2 Average_P: 0.95455 (95%-conf.int. 0.95455 - 0.95455)
+1 ROUGE-2 Average_F: 0.02087 (95%-conf.int. 0.02087 - 0.02087)
+---------------------------------------------
+1 ROUGE-3 Average_R: 0.00955 (95%-conf.int. 0.00955 - 0.00955)
+1 ROUGE-3 Average_P: 0.90476 (95%-conf.int. 0.90476 - 0.90476)
+1 ROUGE-3 Average_F: 0.01890 (95%-conf.int. 0.01890 - 0.01890)
+---------------------------------------------
+1 ROUGE-4 Average_R: 0.00855 (95%-conf.int. 0.00855 - 0.00855)
+1 ROUGE-4 Average_P: 0.85000 (95%-conf.int. 0.85000 - 0.85000)
+1 ROUGE-4 Average_F: 0.01693 (95%-conf.int. 0.01693 - 0.01693)
+---------------------------------------------
+1 ROUGE-L Average_R: 0.01155 (95%-conf.int. 0.01155 - 0.01155)
+1 ROUGE-L Average_P: 1.00000 (95%-conf.int. 1.00000 - 1.00000)
+1 ROUGE-L Average_F: 0.02284 (95%-conf.int. 0.02284 - 0.02284)
+---------------------------------------------
+1 ROUGE-W-1.2 Average_R: 0.00386 (95%-conf.int. 0.00386 - 0.00386)
+1 ROUGE-W-1.2 Average_P: 0.75768 (95%-conf.int. 0.75768 - 0.75768)
+1 ROUGE-W-1.2 Average_F: 0.00768 (95%-conf.int. 0.00768 - 0.00768)
+---------------------------------------------
+1 ROUGE-S* Average_R: 0.00013 (95%-conf.int. 0.00013 - 0.00013)
+1 ROUGE-S* Average_P: 1.00000 (95%-conf.int. 1.00000 - 1.00000)
+1 ROUGE-S* Average_F: 0.00026 (95%-conf.int. 0.00026 - 0.00026)
+---------------------------------------------
+1 ROUGE-SU* Average_R: 0.00014 (95%-conf.int. 0.00014 - 0.00014)
+1 ROUGE-SU* Average_P: 1.00000 (95%-conf.int. 1.00000 - 1.00000)
+1 ROUGE-SU* Average_F: 0.00028 (95%-conf.int. 0.00028 - 0.00028)

evaluation/Perceptron_rouge/atlassian_ROUGE.txt

@@ -0,0 +1,32 @@
+---------------------------------------------
+1 ROUGE-1 Average_R: 0.29393 (95%-conf.int. 0.29393 - 0.29393)
+1 ROUGE-1 Average_P: 0.89220 (95%-conf.int. 0.89220 - 0.89220)
+1 ROUGE-1 Average_F: 0.44218 (95%-conf.int. 0.44218 - 0.44218)
+---------------------------------------------
+1 ROUGE-2 Average_R: 0.22347 (95%-conf.int. 0.22347 - 0.22347)
+1 ROUGE-2 Average_P: 0.67898 (95%-conf.int. 0.67898 - 0.67898)
+1 ROUGE-2 Average_F: 0.33627 (95%-conf.int. 0.33627 - 0.33627)
+---------------------------------------------
+1 ROUGE-3 Average_R: 0.20065 (95%-conf.int. 0.20065 - 0.20065)
+1 ROUGE-3 Average_P: 0.61024 (95%-conf.int. 0.61024 - 0.61024)
+1 ROUGE-3 Average_F: 0.30200 (95%-conf.int. 0.30200 - 0.30200)
+---------------------------------------------
+1 ROUGE-4 Average_R: 0.19092 (95%-conf.int. 0.19092 - 0.19092)
+1 ROUGE-4 Average_P: 0.58120 (95%-conf.int. 0.58120 - 0.58120)
+1 ROUGE-4 Average_F: 0.28742 (95%-conf.int. 0.28742 - 0.28742)
+---------------------------------------------
+1 ROUGE-L Average_R: 0.29252 (95%-conf.int. 0.29252 - 0.29252)
+1 ROUGE-L Average_P: 0.88794 (95%-conf.int. 0.88794 - 0.88794)
+1 ROUGE-L Average_F: 0.44007 (95%-conf.int. 0.44007 - 0.44007)
+---------------------------------------------
+1 ROUGE-W-1.2 Average_R: 0.06236 (95%-conf.int. 0.06236 - 0.06236)
+1 ROUGE-W-1.2 Average_P: 0.39217 (95%-conf.int. 0.39217 - 0.39217)
+1 ROUGE-W-1.2 Average_F: 0.10761 (95%-conf.int. 0.10761 - 0.10761)
+---------------------------------------------
+1 ROUGE-S* Average_R: 0.08353 (95%-conf.int. 0.08353 - 0.08353)
+1 ROUGE-S* Average_P: 0.77040 (95%-conf.int. 0.77040 - 0.77040)
+1 ROUGE-S* Average_F: 0.15072 (95%-conf.int. 0.15072 - 0.15072)
+---------------------------------------------
+1 ROUGE-SU* Average_R: 0.08373 (95%-conf.int. 0.08373 - 0.08373)
+1 ROUGE-SU* Average_P: 0.77074 (95%-conf.int. 0.77074 - 0.77074)
+1 ROUGE-SU* Average_F: 0.15105 (95%-conf.int. 0.15105 - 0.15105)

evaluation/Perceptron_rouge/instagram_ROUGE.txt

@@ -0,0 +1,32 @@
+---------------------------------------------
+1 ROUGE-1 Average_R: 0.97449 (95%-conf.int. 0.97449 - 0.97449)
+1 ROUGE-1 Average_P: 0.41794 (95%-conf.int. 0.41794 - 0.41794)
+1 ROUGE-1 Average_F: 0.58499 (95%-conf.int. 0.58499 - 0.58499)
+---------------------------------------------
+1 ROUGE-2 Average_R: 0.87527 (95%-conf.int. 0.87527 - 0.87527)
+1 ROUGE-2 Average_P: 0.37523 (95%-conf.int. 0.37523 - 0.37523)
+1 ROUGE-2 Average_F: 0.52527 (95%-conf.int. 0.52527 - 0.52527)
+---------------------------------------------
+1 ROUGE-3 Average_R: 0.80511 (95%-conf.int. 0.80511 - 0.80511)
+1 ROUGE-3 Average_P: 0.34501 (95%-conf.int. 0.34501 - 0.34501)
+1 ROUGE-3 Average_F: 0.48303 (95%-conf.int. 0.48303 - 0.48303)
+---------------------------------------------
+1 ROUGE-4 Average_R: 0.76333 (95%-conf.int. 0.76333 - 0.76333)
+1 ROUGE-4 Average_P: 0.32697 (95%-conf.int. 0.32697 - 0.32697)
+1 ROUGE-4 Average_F: 0.45783 (95%-conf.int. 0.45783 - 0.45783)
+---------------------------------------------
+1 ROUGE-L Average_R: 0.97085 (95%-conf.int. 0.97085 - 0.97085)
+1 ROUGE-L Average_P: 0.41638 (95%-conf.int. 0.41638 - 0.41638)
+1 ROUGE-L Average_F: 0.58281 (95%-conf.int. 0.58281 - 0.58281)
+---------------------------------------------
+1 ROUGE-W-1.2 Average_R: 0.24802 (95%-conf.int. 0.24802 - 0.24802)
+1 ROUGE-W-1.2 Average_P: 0.22475 (95%-conf.int. 0.22475 - 0.22475)
+1 ROUGE-W-1.2 Average_F: 0.23581 (95%-conf.int. 0.23581 - 0.23581)
+---------------------------------------------
+1 ROUGE-S* Average_R: 0.92544 (95%-conf.int. 0.92544 - 0.92544)
+1 ROUGE-S* Average_P: 0.17016 (95%-conf.int. 0.17016 - 0.17016)
+1 ROUGE-S* Average_F: 0.28746 (95%-conf.int. 0.28746 - 0.28746)
+---------------------------------------------
+1 ROUGE-SU* Average_R: 0.92551 (95%-conf.int. 0.92551 - 0.92551)
+1 ROUGE-SU* Average_P: 0.17031 (95%-conf.int. 0.17031 - 0.17031)
+1 ROUGE-SU* Average_F: 0.28768 (95%-conf.int. 0.28768 - 0.28768)

evaluation/Perceptron_rouge/reddit_ROUGE.txt

@@ -0,0 +1,32 @@
+---------------------------------------------
+1 ROUGE-1 Average_R: 0.04156 (95%-conf.int. 0.04156 - 0.04156)
+1 ROUGE-1 Average_P: 1.00000 (95%-conf.int. 1.00000 - 1.00000)
+1 ROUGE-1 Average_F: 0.07980 (95%-conf.int. 0.07980 - 0.07980)
+---------------------------------------------
+1 ROUGE-2 Average_R: 0.04025 (95%-conf.int. 0.04025 - 0.04025)
+1 ROUGE-2 Average_P: 0.97849 (95%-conf.int. 0.97849 - 0.97849)
+1 ROUGE-2 Average_F: 0.07732 (95%-conf.int. 0.07732 - 0.07732)
+---------------------------------------------
+1 ROUGE-3 Average_R: 0.03894 (95%-conf.int. 0.03894 - 0.03894)
+1 ROUGE-3 Average_P: 0.95652 (95%-conf.int. 0.95652 - 0.95652)
+1 ROUGE-3 Average_F: 0.07483 (95%-conf.int. 0.07483 - 0.07483)
+---------------------------------------------
+1 ROUGE-4 Average_R: 0.03763 (95%-conf.int. 0.03763 - 0.03763)
+1 ROUGE-4 Average_P: 0.93407 (95%-conf.int. 0.93407 - 0.93407)
+1 ROUGE-4 Average_F: 0.07235 (95%-conf.int. 0.07235 - 0.07235)
+---------------------------------------------
+1 ROUGE-L Average_R: 0.04156 (95%-conf.int. 0.04156 - 0.04156)
+1 ROUGE-L Average_P: 1.00000 (95%-conf.int. 1.00000 - 1.00000)
+1 ROUGE-L Average_F: 0.07980 (95%-conf.int. 0.07980 - 0.07980)
+---------------------------------------------
+1 ROUGE-W-1.2 Average_R: 0.00626 (95%-conf.int. 0.00626 - 0.00626)
+1 ROUGE-W-1.2 Average_P: 0.32845 (95%-conf.int. 0.32845 - 0.32845)
+1 ROUGE-W-1.2 Average_F: 0.01229 (95%-conf.int. 0.01229 - 0.01229)
+---------------------------------------------
+1 ROUGE-S* Average_R: 0.00163 (95%-conf.int. 0.00163 - 0.00163)
+1 ROUGE-S* Average_P: 0.95241 (95%-conf.int. 0.95241 - 0.95241)
+1 ROUGE-S* Average_F: 0.00325 (95%-conf.int. 0.00325 - 0.00325)
+---------------------------------------------
+1 ROUGE-SU* Average_R: 0.00166 (95%-conf.int. 0.00166 - 0.00166)
+1 ROUGE-SU* Average_P: 0.95341 (95%-conf.int. 0.95341 - 0.95341)
+1 ROUGE-SU* Average_F: 0.00331 (95%-conf.int. 0.00331 - 0.00331)

evaluation/Perceptron_rouge/rovio_ROUGE.txt

@@ -0,0 +1,32 @@
+---------------------------------------------
+1 ROUGE-1 Average_R: 0.99793 (95%-conf.int. 0.99793 - 0.99793)
+1 ROUGE-1 Average_P: 0.21282 (95%-conf.int. 0.21282 - 0.21282)
+1 ROUGE-1 Average_F: 0.35082 (95%-conf.int. 0.35082 - 0.35082)
+---------------------------------------------
+1 ROUGE-2 Average_R: 0.96680 (95%-conf.int. 0.96680 - 0.96680)
+1 ROUGE-2 Average_P: 0.20607 (95%-conf.int. 0.20607 - 0.20607)
+1 ROUGE-2 Average_F: 0.33973 (95%-conf.int. 0.33973 - 0.33973)
+---------------------------------------------
+1 ROUGE-3 Average_R: 0.93772 (95%-conf.int. 0.93772 - 0.93772)
+1 ROUGE-3 Average_P: 0.19976 (95%-conf.int. 0.19976 - 0.19976)
+1 ROUGE-3 Average_F: 0.32936 (95%-conf.int. 0.32936 - 0.32936)
+---------------------------------------------
+1 ROUGE-4 Average_R: 0.91343 (95%-conf.int. 0.91343 - 0.91343)
+1 ROUGE-4 Average_P: 0.19449 (95%-conf.int. 0.19449 - 0.19449)
+1 ROUGE-4 Average_F: 0.32070 (95%-conf.int. 0.32070 - 0.32070)
+---------------------------------------------
+1 ROUGE-L Average_R: 0.99516 (95%-conf.int. 0.99516 - 0.99516)
+1 ROUGE-L Average_P: 0.21223 (95%-conf.int. 0.21223 - 0.21223)
+1 ROUGE-L Average_F: 0.34985 (95%-conf.int. 0.34985 - 0.34985)
+---------------------------------------------
+1 ROUGE-W-1.2 Average_R: 0.25556 (95%-conf.int. 0.25556 - 0.25556)
+1 ROUGE-W-1.2 Average_P: 0.12507 (95%-conf.int. 0.12507 - 0.12507)
+1 ROUGE-W-1.2 Average_F: 0.16795 (95%-conf.int. 0.16795 - 0.16795)
+---------------------------------------------
+1 ROUGE-S* Average_R: 0.96771 (95%-conf.int. 0.96771 - 0.96771)
+1 ROUGE-S* Average_P: 0.04399 (95%-conf.int. 0.04399 - 0.04399)
+1 ROUGE-S* Average_F: 0.08415 (95%-conf.int. 0.08415 - 0.08415)
+---------------------------------------------
+1 ROUGE-SU* Average_R: 0.96775 (95%-conf.int. 0.96775 - 0.96775)
+1 ROUGE-SU* Average_P: 0.04404 (95%-conf.int. 0.04404 - 0.04404)
+1 ROUGE-SU* Average_F: 0.08425 (95%-conf.int. 0.08425 - 0.08425)

evaluation/Perceptron_rouge/twitter_ROUGE.txt

@@ -0,0 +1,32 @@
+---------------------------------------------
+1 ROUGE-1 Average_R: 0.12826 (95%-conf.int. 0.12826 - 0.12826)
+1 ROUGE-1 Average_P: 0.85417 (95%-conf.int. 0.85417 - 0.85417)
+1 ROUGE-1 Average_F: 0.22303 (95%-conf.int. 0.22303 - 0.22303)
+---------------------------------------------
+1 ROUGE-2 Average_R: 0.08559 (95%-conf.int. 0.08559 - 0.08559)
+1 ROUGE-2 Average_P: 0.57343 (95%-conf.int. 0.57343 - 0.57343)
+1 ROUGE-2 Average_F: 0.14895 (95%-conf.int. 0.14895 - 0.14895)
+---------------------------------------------
+1 ROUGE-3 Average_R: 0.07524 (95%-conf.int. 0.07524 - 0.07524)
+1 ROUGE-3 Average_P: 0.50704 (95%-conf.int. 0.50704 - 0.50704)
+1 ROUGE-3 Average_F: 0.13104 (95%-conf.int. 0.13104 - 0.13104)
+---------------------------------------------
+1 ROUGE-4 Average_R: 0.07008 (95%-conf.int. 0.07008 - 0.07008)
+1 ROUGE-4 Average_P: 0.47518 (95%-conf.int. 0.47518 - 0.47518)
+1 ROUGE-4 Average_F: 0.12215 (95%-conf.int. 0.12215 - 0.12215)
+---------------------------------------------
+1 ROUGE-L Average_R: 0.12409 (95%-conf.int. 0.12409 - 0.12409)
+1 ROUGE-L Average_P: 0.82639 (95%-conf.int. 0.82639 - 0.82639)
+1 ROUGE-L Average_F: 0.21578 (95%-conf.int. 0.21578 - 0.21578)
+---------------------------------------------
+1 ROUGE-W-1.2 Average_R: 0.03895 (95%-conf.int. 0.03895 - 0.03895)
+1 ROUGE-W-1.2 Average_P: 0.52120 (95%-conf.int. 0.52120 - 0.52120)
+1 ROUGE-W-1.2 Average_F: 0.07248 (95%-conf.int. 0.07248 - 0.07248)
+---------------------------------------------
+1 ROUGE-S* Average_R: 0.01611 (95%-conf.int. 0.01611 - 0.01611)
+1 ROUGE-S* Average_P: 0.71873 (95%-conf.int. 0.71873 - 0.71873)
+1 ROUGE-S* Average_F: 0.03151 (95%-conf.int. 0.03151 - 0.03151)
+---------------------------------------------
+1 ROUGE-SU* Average_R: 0.01634 (95%-conf.int. 0.01634 - 0.01634)
+1 ROUGE-SU* Average_P: 0.72057 (95%-conf.int. 0.72057 - 0.72057)
+1 ROUGE-SU* Average_F: 0.03196 (95%-conf.int. 0.03196 - 0.03196)

evaluation/SVC_rouge/amazon.txt

@@ -0,0 +1,32 @@
+---------------------------------------------
+1 ROUGE-1 Average_R: 0.12826 (95%-conf.int. 0.12826 - 0.12826)
+1 ROUGE-1 Average_P: 0.85417 (95%-conf.int. 0.85417 - 0.85417)
+1 ROUGE-1 Average_F: 0.22303 (95%-conf.int. 0.22303 - 0.22303)
+---------------------------------------------
+1 ROUGE-2 Average_R: 0.08559 (95%-conf.int. 0.08559 - 0.08559)
+1 ROUGE-2 Average_P: 0.57343 (95%-conf.int. 0.57343 - 0.57343)
+1 ROUGE-2 Average_F: 0.14895 (95%-conf.int. 0.14895 - 0.14895)
+---------------------------------------------
+1 ROUGE-3 Average_R: 0.07524 (95%-conf.int. 0.07524 - 0.07524)
+1 ROUGE-3 Average_P: 0.50704 (95%-conf.int. 0.50704 - 0.50704)
+1 ROUGE-3 Average_F: 0.13104 (95%-conf.int. 0.13104 - 0.13104)
+---------------------------------------------
+1 ROUGE-4 Average_R: 0.07008 (95%-conf.int. 0.07008 - 0.07008)
+1 ROUGE-4 Average_P: 0.47518 (95%-conf.int. 0.47518 - 0.47518)
+1 ROUGE-4 Average_F: 0.12215 (95%-conf.int. 0.12215 - 0.12215)
+---------------------------------------------
+1 ROUGE-L Average_R: 0.12409 (95%-conf.int. 0.12409 - 0.12409)
+1 ROUGE-L Average_P: 0.82639 (95%-conf.int. 0.82639 - 0.82639)
+1 ROUGE-L Average_F: 0.21578 (95%-conf.int. 0.21578 - 0.21578)
+---------------------------------------------
+1 ROUGE-W-1.2 Average_R: 0.03895 (95%-conf.int. 0.03895 - 0.03895)
+1 ROUGE-W-1.2 Average_P: 0.52120 (95%-conf.int. 0.52120 - 0.52120)
+1 ROUGE-W-1.2 Average_F: 0.07248 (95%-conf.int. 0.07248 - 0.07248)
+---------------------------------------------
+1 ROUGE-S* Average_R: 0.01611 (95%-conf.int. 0.01611 - 0.01611)
+1 ROUGE-S* Average_P: 0.71873 (95%-conf.int. 0.71873 - 0.71873)
+1 ROUGE-S* Average_F: 0.03151 (95%-conf.int. 0.03151 - 0.03151)
+---------------------------------------------
+1 ROUGE-SU* Average_R: 0.01634 (95%-conf.int. 0.01634 - 0.01634)
+1 ROUGE-SU* Average_P: 0.72057 (95%-conf.int. 0.72057 - 0.72057)
+1 ROUGE-SU* Average_F: 0.03196 (95%-conf.int. 0.03196 - 0.03196)

evaluation/SVC_rouge/amazon_ROUGE.txt

@@ -0,0 +1,32 @@
+---------------------------------------------
+1 ROUGE-1 Average_R: 0.45605 (95%-conf.int. 0.45605 - 0.45605)
+1 ROUGE-1 Average_P: 0.79094 (95%-conf.int. 0.79094 - 0.79094)
+1 ROUGE-1 Average_F: 0.57853 (95%-conf.int. 0.57853 - 0.57853)
+---------------------------------------------
+1 ROUGE-2 Average_R: 0.29196 (95%-conf.int. 0.29196 - 0.29196)
+1 ROUGE-2 Average_P: 0.50654 (95%-conf.int. 0.50654 - 0.50654)
+1 ROUGE-2 Average_F: 0.37042 (95%-conf.int. 0.37042 - 0.37042)
+---------------------------------------------
+1 ROUGE-3 Average_R: 0.24334 (95%-conf.int. 0.24334 - 0.24334)
+1 ROUGE-3 Average_P: 0.42234 (95%-conf.int. 0.42234 - 0.42234)
+1 ROUGE-3 Average_F: 0.30877 (95%-conf.int. 0.30877 - 0.30877)
+---------------------------------------------
+1 ROUGE-4 Average_R: 0.22686 (95%-conf.int. 0.22686 - 0.22686)
+1 ROUGE-4 Average_P: 0.39389 (95%-conf.int. 0.39389 - 0.39389)
+1 ROUGE-4 Average_F: 0.28790 (95%-conf.int. 0.28790 - 0.28790)
+---------------------------------------------
+1 ROUGE-L Average_R: 0.43797 (95%-conf.int. 0.43797 - 0.43797)
+1 ROUGE-L Average_P: 0.75958 (95%-conf.int. 0.75958 - 0.75958)
+1 ROUGE-L Average_F: 0.55559 (95%-conf.int. 0.55559 - 0.55559)
+---------------------------------------------
+1 ROUGE-W-1.2 Average_R: 0.08593 (95%-conf.int. 0.08593 - 0.08593)
+1 ROUGE-W-1.2 Average_P: 0.33814 (95%-conf.int. 0.33814 - 0.33814)
+1 ROUGE-W-1.2 Average_F: 0.13704 (95%-conf.int. 0.13704 - 0.13704)
+---------------------------------------------
+1 ROUGE-S* Average_R: 0.20998 (95%-conf.int. 0.20998 - 0.20998)
+1 ROUGE-S* Average_P: 0.63182 (95%-conf.int. 0.63182 - 0.63182)
+1 ROUGE-S* Average_F: 0.31520 (95%-conf.int. 0.31520 - 0.31520)
+---------------------------------------------
+1 ROUGE-SU* Average_R: 0.21023 (95%-conf.int. 0.21023 - 0.21023)
+1 ROUGE-SU* Average_P: 0.63210 (95%-conf.int. 0.63210 - 0.63210)
+1 ROUGE-SU* Average_F: 0.31552 (95%-conf.int. 0.31552 - 0.31552)

evaluation/SVC_rouge/atlassian.txt

@@ -0,0 +1,32 @@
+---------------------------------------------
+1 ROUGE-1 Average_R: 0.45605 (95%-conf.int. 0.45605 - 0.45605)
+1 ROUGE-1 Average_P: 0.79094 (95%-conf.int. 0.79094 - 0.79094)
+1 ROUGE-1 Average_F: 0.57853 (95%-conf.int. 0.57853 - 0.57853)
+---------------------------------------------
+1 ROUGE-2 Average_R: 0.29196 (95%-conf.int. 0.29196 - 0.29196)
+1 ROUGE-2 Average_P: 0.50654 (95%-conf.int. 0.50654 - 0.50654)
+1 ROUGE-2 Average_F: 0.37042 (95%-conf.int. 0.37042 - 0.37042)
+---------------------------------------------
+1 ROUGE-3 Average_R: 0.24334 (95%-conf.int. 0.24334 - 0.24334)
+1 ROUGE-3 Average_P: 0.42234 (95%-conf.int. 0.42234 - 0.42234)
+1 ROUGE-3 Average_F: 0.30877 (95%-conf.int. 0.30877 - 0.30877)
+---------------------------------------------
+1 ROUGE-4 Average_R: 0.22686 (95%-conf.int. 0.22686 - 0.22686)
+1 ROUGE-4 Average_P: 0.39389 (95%-conf.int. 0.39389 - 0.39389)
+1 ROUGE-4 Average_F: 0.28790 (95%-conf.int. 0.28790 - 0.28790)
+---------------------------------------------
+1 ROUGE-L Average_R: 0.43797 (95%-conf.int. 0.43797 - 0.43797)
+1 ROUGE-L Average_P: 0.75958 (95%-conf.int. 0.75958 - 0.75958)
+1 ROUGE-L Average_F: 0.55559 (95%-conf.int. 0.55559 - 0.55559)
+---------------------------------------------
+1 ROUGE-W-1.2 Average_R: 0.08593 (95%-conf.int. 0.08593 - 0.08593)
+1 ROUGE-W-1.2 Average_P: 0.33814 (95%-conf.int. 0.33814 - 0.33814)
+1 ROUGE-W-1.2 Average_F: 0.13704 (95%-conf.int. 0.13704 - 0.13704)
+---------------------------------------------
+1 ROUGE-S* Average_R: 0.20998 (95%-conf.int. 0.20998 - 0.20998)
+1 ROUGE-S* Average_P: 0.63182 (95%-conf.int. 0.63182 - 0.63182)
+1 ROUGE-S* Average_F: 0.31520 (95%-conf.int. 0.31520 - 0.31520)
+---------------------------------------------
+1 ROUGE-SU* Average_R: 0.21023 (95%-conf.int. 0.21023 - 0.21023)
+1 ROUGE-SU* Average_P: 0.63210 (95%-conf.int. 0.63210 - 0.63210)
+1 ROUGE-SU* Average_F: 0.31552 (95%-conf.int. 0.31552 - 0.31552)

evaluation/SVC_rouge/atlassian_ROUGE.txt

@@ -0,0 +1,32 @@
+---------------------------------------------
+1 ROUGE-1 Average_R: 0.08738 (95%-conf.int. 0.08738 - 0.08738)
+1 ROUGE-1 Average_P: 0.95897 (95%-conf.int. 0.95897 - 0.95897)
+1 ROUGE-1 Average_F: 0.16017 (95%-conf.int. 0.16017 - 0.16017)
+---------------------------------------------
+1 ROUGE-2 Average_R: 0.07620 (95%-conf.int. 0.07620 - 0.07620)
+1 ROUGE-2 Average_P: 0.84021 (95%-conf.int. 0.84021 - 0.84021)
+1 ROUGE-2 Average_F: 0.13973 (95%-conf.int. 0.13973 - 0.13973)
+---------------------------------------------
+1 ROUGE-3 Average_R: 0.07109 (95%-conf.int. 0.07109 - 0.07109)
+1 ROUGE-3 Average_P: 0.78756 (95%-conf.int. 0.78756 - 0.78756)
+1 ROUGE-3 Average_F: 0.13041 (95%-conf.int. 0.13041 - 0.13041)
+---------------------------------------------
+1 ROUGE-4 Average_R: 0.06879 (95%-conf.int. 0.06879 - 0.06879)
+1 ROUGE-4 Average_P: 0.76562 (95%-conf.int. 0.76562 - 0.76562)
+1 ROUGE-4 Average_F: 0.12624 (95%-conf.int. 0.12624 - 0.12624)
+---------------------------------------------
+1 ROUGE-L Average_R: 0.08738 (95%-conf.int. 0.08738 - 0.08738)
+1 ROUGE-L Average_P: 0.95897 (95%-conf.int. 0.95897 - 0.95897)
+1 ROUGE-L Average_F: 0.16017 (95%-conf.int. 0.16017 - 0.16017)
+---------------------------------------------
+1 ROUGE-W-1.2 Average_R: 0.01482 (95%-conf.int. 0.01482 - 0.01482)
+1 ROUGE-W-1.2 Average_P: 0.33693 (95%-conf.int. 0.33693 - 0.33693)
+1 ROUGE-W-1.2 Average_F: 0.02839 (95%-conf.int. 0.02839 - 0.02839)
+---------------------------------------------
+1 ROUGE-S* Average_R: 0.00730 (95%-conf.int. 0.00730 - 0.00730)
+1 ROUGE-S* Average_P: 0.88337 (95%-conf.int. 0.88337 - 0.88337)
+1 ROUGE-S* Average_F: 0.01448 (95%-conf.int. 0.01448 - 0.01448)
+---------------------------------------------
+1 ROUGE-SU* Average_R: 0.00737 (95%-conf.int. 0.00737 - 0.00737)
+1 ROUGE-SU* Average_P: 0.88414 (95%-conf.int. 0.88414 - 0.88414)
+1 ROUGE-SU* Average_F: 0.01462 (95%-conf.int. 0.01462 - 0.01462)

evaluation/SVC_rouge/instagram.txt

@@ -0,0 +1,32 @@
+---------------------------------------------
+1 ROUGE-1 Average_R: 0.08738 (95%-conf.int. 0.08738 - 0.08738)
+1 ROUGE-1 Average_P: 0.95897 (95%-conf.int. 0.95897 - 0.95897)
+1 ROUGE-1 Average_F: 0.16017 (95%-conf.int. 0.16017 - 0.16017)
+---------------------------------------------
+1 ROUGE-2 Average_R: 0.07620 (95%-conf.int. 0.07620 - 0.07620)
+1 ROUGE-2 Average_P: 0.84021 (95%-conf.int. 0.84021 - 0.84021)
+1 ROUGE-2 Average_F: 0.13973 (95%-conf.int. 0.13973 - 0.13973)
+---------------------------------------------
+1 ROUGE-3 Average_R: 0.07109 (95%-conf.int. 0.07109 - 0.07109)
+1 ROUGE-3 Average_P: 0.78756 (95%-conf.int. 0.78756 - 0.78756)
+1 ROUGE-3 Average_F: 0.13041 (95%-conf.int. 0.13041 - 0.13041)
+---------------------------------------------
+1 ROUGE-4 Average_R: 0.06879 (95%-conf.int. 0.06879 - 0.06879)
+1 ROUGE-4 Average_P: 0.76562 (95%-conf.int. 0.76562 - 0.76562)
+1 ROUGE-4 Average_F: 0.12624 (95%-conf.int. 0.12624 - 0.12624)
+---------------------------------------------
+1 ROUGE-L Average_R: 0.08738 (95%-conf.int. 0.08738 - 0.08738)
+1 ROUGE-L Average_P: 0.95897 (95%-conf.int. 0.95897 - 0.95897)
+1 ROUGE-L Average_F: 0.16017 (95%-conf.int. 0.16017 - 0.16017)
+---------------------------------------------
+1 ROUGE-W-1.2 Average_R: 0.01482 (95%-conf.int. 0.01482 - 0.01482)
+1 ROUGE-W-1.2 Average_P: 0.33693 (95%-conf.int. 0.33693 - 0.33693)
+1 ROUGE-W-1.2 Average_F: 0.02839 (95%-conf.int. 0.02839 - 0.02839)
+---------------------------------------------
+1 ROUGE-S* Average_R: 0.00730 (95%-conf.int. 0.00730 - 0.00730)
+1 ROUGE-S* Average_P: 0.88337 (95%-conf.int. 0.88337 - 0.88337)
+1 ROUGE-S* Average_F: 0.01448 (95%-conf.int. 0.01448 - 0.01448)
+---------------------------------------------
+1 ROUGE-SU* Average_R: 0.00737 (95%-conf.int. 0.00737 - 0.00737)
+1 ROUGE-SU* Average_P: 0.88414 (95%-conf.int. 0.88414 - 0.88414)
+1 ROUGE-SU* Average_F: 0.01462 (95%-conf.int. 0.01462 - 0.01462)

evaluation/SVC_rouge/instagram_ROUGE.txt

@@ -0,0 +1,32 @@
+---------------------------------------------
+1 ROUGE-1 Average_R: 0.18222 (95%-conf.int. 0.18222 - 0.18222)
+1 ROUGE-1 Average_P: 0.92593 (95%-conf.int. 0.92593 - 0.92593)
+1 ROUGE-1 Average_F: 0.30451 (95%-conf.int. 0.30451 - 0.30451)
+---------------------------------------------
+1 ROUGE-2 Average_R: 0.15317 (95%-conf.int. 0.15317 - 0.15317)
+1 ROUGE-2 Average_P: 0.78067 (95%-conf.int. 0.78067 - 0.78067)
+1 ROUGE-2 Average_F: 0.25609 (95%-conf.int. 0.25609 - 0.25609)
+---------------------------------------------
+1 ROUGE-3 Average_R: 0.13942 (95%-conf.int. 0.13942 - 0.13942)
+1 ROUGE-3 Average_P: 0.71269 (95%-conf.int. 0.71269 - 0.71269)
+1 ROUGE-3 Average_F: 0.23322 (95%-conf.int. 0.23322 - 0.23322)
+---------------------------------------------
+1 ROUGE-4 Average_R: 0.13221 (95%-conf.int. 0.13221 - 0.13221)
+1 ROUGE-4 Average_P: 0.67790 (95%-conf.int. 0.67790 - 0.67790)
+1 ROUGE-4 Average_F: 0.22127 (95%-conf.int. 0.22127 - 0.22127)
+---------------------------------------------
+1 ROUGE-L Average_R: 0.18003 (95%-conf.int. 0.18003 - 0.18003)
+1 ROUGE-L Average_P: 0.91481 (95%-conf.int. 0.91481 - 0.91481)
+1 ROUGE-L Average_F: 0.30085 (95%-conf.int. 0.30085 - 0.30085)
+---------------------------------------------
+1 ROUGE-W-1.2 Average_R: 0.02758 (95%-conf.int. 0.02758 - 0.02758)
+1 ROUGE-W-1.2 Average_P: 0.29617 (95%-conf.int. 0.29617 - 0.29617)
+1 ROUGE-W-1.2 Average_F: 0.05046 (95%-conf.int. 0.05046 - 0.05046)
+---------------------------------------------
+1 ROUGE-S* Average_R: 0.03180 (95%-conf.int. 0.03180 - 0.03180)
+1 ROUGE-S* Average_P: 0.82349 (95%-conf.int. 0.82349 - 0.82349)
+1 ROUGE-S* Average_F: 0.06124 (95%-conf.int. 0.06124 - 0.06124)
+---------------------------------------------
+1 ROUGE-SU* Average_R: 0.03201 (95%-conf.int. 0.03201 - 0.03201)
+1 ROUGE-SU* Average_P: 0.82424 (95%-conf.int. 0.82424 - 0.82424)
+1 ROUGE-SU* Average_F: 0.06163 (95%-conf.int. 0.06163 - 0.06163)

evaluation/SVC_rouge/reddit_ROUGE.txt

@@ -0,0 +1,32 @@
+---------------------------------------------
+1 ROUGE-1 Average_R: 0.11141 (95%-conf.int. 0.11141 - 0.11141)
+1 ROUGE-1 Average_P: 0.92647 (95%-conf.int. 0.92647 - 0.92647)
+1 ROUGE-1 Average_F: 0.19890 (95%-conf.int. 0.19890 - 0.19890)
+---------------------------------------------
+1 ROUGE-2 Average_R: 0.09465 (95%-conf.int. 0.09465 - 0.09465)
+1 ROUGE-2 Average_P: 0.78967 (95%-conf.int. 0.78967 - 0.78967)
+1 ROUGE-2 Average_F: 0.16904 (95%-conf.int. 0.16904 - 0.16904)
+---------------------------------------------
+1 ROUGE-3 Average_R: 0.09071 (95%-conf.int. 0.09071 - 0.09071)
+1 ROUGE-3 Average_P: 0.75926 (95%-conf.int. 0.75926 - 0.75926)
+1 ROUGE-3 Average_F: 0.16206 (95%-conf.int. 0.16206 - 0.16206)
+---------------------------------------------
+1 ROUGE-4 Average_R: 0.08809 (95%-conf.int. 0.08809 - 0.08809)
+1 ROUGE-4 Average_P: 0.73978 (95%-conf.int. 0.73978 - 0.73978)
+1 ROUGE-4 Average_F: 0.15743 (95%-conf.int. 0.15743 - 0.15743)
+---------------------------------------------
+1 ROUGE-L Average_R: 0.11008 (95%-conf.int. 0.11008 - 0.11008)
+1 ROUGE-L Average_P: 0.91544 (95%-conf.int. 0.91544 - 0.91544)
+1 ROUGE-L Average_F: 0.19653 (95%-conf.int. 0.19653 - 0.19653)
+---------------------------------------------
+1 ROUGE-W-1.2 Average_R: 0.02517 (95%-conf.int. 0.02517 - 0.02517)
+1 ROUGE-W-1.2 Average_P: 0.45672 (95%-conf.int. 0.45672 - 0.45672)
+1 ROUGE-W-1.2 Average_F: 0.04771 (95%-conf.int. 0.04771 - 0.04771)
+---------------------------------------------
+1 ROUGE-S* Average_R: 0.01189 (95%-conf.int. 0.01189 - 0.01189)
+1 ROUGE-S* Average_P: 0.82489 (95%-conf.int. 0.82489 - 0.82489)
+1 ROUGE-S* Average_F: 0.02344 (95%-conf.int. 0.02344 - 0.02344)
+---------------------------------------------
+1 ROUGE-SU* Average_R: 0.01198 (95%-conf.int. 0.01198 - 0.01198)
+1 ROUGE-SU* Average_P: 0.82563 (95%-conf.int. 0.82563 - 0.82563)
+1 ROUGE-SU* Average_F: 0.02362 (95%-conf.int. 0.02362 - 0.02362)

evaluation/SVC_rouge/rovio_ROUGE.txt

@@ -0,0 +1,32 @@
+---------------------------------------------
+1 ROUGE-1 Average_R: 0.57360 (95%-conf.int. 0.57360 - 0.57360)
+1 ROUGE-1 Average_P: 0.70940 (95%-conf.int. 0.70940 - 0.70940)
+1 ROUGE-1 Average_F: 0.63431 (95%-conf.int. 0.63431 - 0.63431)
+---------------------------------------------
+1 ROUGE-2 Average_R: 0.39627 (95%-conf.int. 0.39627 - 0.39627)
+1 ROUGE-2 Average_P: 0.49016 (95%-conf.int. 0.49016 - 0.49016)
+1 ROUGE-2 Average_F: 0.43824 (95%-conf.int. 0.43824 - 0.43824)
+---------------------------------------------
+1 ROUGE-3 Average_R: 0.33910 (95%-conf.int. 0.33910 - 0.33910)
+1 ROUGE-3 Average_P: 0.41952 (95%-conf.int. 0.41952 - 0.41952)
+1 ROUGE-3 Average_F: 0.37505 (95%-conf.int. 0.37505 - 0.37505)
+---------------------------------------------
+1 ROUGE-4 Average_R: 0.31094 (95%-conf.int. 0.31094 - 0.31094)
+1 ROUGE-4 Average_P: 0.38475 (95%-conf.int. 0.38475 - 0.38475)
+1 ROUGE-4 Average_F: 0.34393 (95%-conf.int. 0.34393 - 0.34393)
+---------------------------------------------
+1 ROUGE-L Average_R: 0.54803 (95%-conf.int. 0.54803 - 0.54803)
+1 ROUGE-L Average_P: 0.67778 (95%-conf.int. 0.67778 - 0.67778)
+1 ROUGE-L Average_F: 0.60604 (95%-conf.int. 0.60604 - 0.60604)
+---------------------------------------------
+1 ROUGE-W-1.2 Average_R: 0.07490 (95%-conf.int. 0.07490 - 0.07490)
+1 ROUGE-W-1.2 Average_P: 0.21257 (95%-conf.int. 0.21257 - 0.21257)
+1 ROUGE-W-1.2 Average_F: 0.11077 (95%-conf.int. 0.11077 - 0.11077)
+---------------------------------------------
+1 ROUGE-S* Average_R: 0.35392 (95%-conf.int. 0.35392 - 0.35392)
+1 ROUGE-S* Average_P: 0.54143 (95%-conf.int. 0.54143 - 0.54143)
+1 ROUGE-S* Average_F: 0.42804 (95%-conf.int. 0.42804 - 0.42804)
+---------------------------------------------
+1 ROUGE-SU* Average_R: 0.35422 (95%-conf.int. 0.35422 - 0.35422)
+1 ROUGE-SU* Average_P: 0.54171 (95%-conf.int. 0.54171 - 0.54171)
+1 ROUGE-SU* Average_F: 0.42835 (95%-conf.int. 0.42835 - 0.42835)

evaluation/SVC_rouge/twitter_ROUGE.txt

@@ -1,9 +1,13 @@
 import os
 import rouge_score_model_2
 
-in_directory = '/home/tangc/Documents/NLP/Project/NLP-TOS-Summarization/data/smmry_tosdr_corpus/smmry_input/'
-out_directory = '/home/tangc/Documents/NLP/Project/NLP-TOS-Summarization/data/smmry_tosdr_corpus/smmry_output/'
+directory = '/home/tangc/Documents/NLP/Project/NLP-TOS-Summarization/evaluation/'
 
-for filename in os.listdir(in_directory):
-  if filename.endswith(".txt"):
-    rouge_score_model_2.main(filename[:-4], filename[:-4])
+with open("all_model_ROUGE_1.txt", "w") as dump:
+  for filename in os.listdir(directory):
+    if filename.endswith(".txt"):
+      # Used to automate ROUGE score calculation
+      # rouge_score_model_2.main(filename[:-4], filename[:-4])
+      f = open(filename)
+      lines = f.read()
+      dump.write(filename + "-----\n" + lines + "\n\n")

evaluation/all_model_ROUGE_1.txt

@@ -0,0 +1,32 @@
+---------------------------------------------
+1 ROUGE-1 Average_R: 0.12826 (95%-conf.int. 0.12826 - 0.12826)
+1 ROUGE-1 Average_P: 0.85417 (95%-conf.int. 0.85417 - 0.85417)
+1 ROUGE-1 Average_F: 0.22303 (95%-conf.int. 0.22303 - 0.22303)
+---------------------------------------------
+1 ROUGE-2 Average_R: 0.08559 (95%-conf.int. 0.08559 - 0.08559)
+1 ROUGE-2 Average_P: 0.57343 (95%-conf.int. 0.57343 - 0.57343)
+1 ROUGE-2 Average_F: 0.14895 (95%-conf.int. 0.14895 - 0.14895)
+---------------------------------------------
+1 ROUGE-3 Average_R: 0.07524 (95%-conf.int. 0.07524 - 0.07524)
+1 ROUGE-3 Average_P: 0.50704 (95%-conf.int. 0.50704 - 0.50704)
+1 ROUGE-3 Average_F: 0.13104 (95%-conf.int. 0.13104 - 0.13104)
+---------------------------------------------
+1 ROUGE-4 Average_R: 0.07008 (95%-conf.int. 0.07008 - 0.07008)
+1 ROUGE-4 Average_P: 0.47518 (95%-conf.int. 0.47518 - 0.47518)
+1 ROUGE-4 Average_F: 0.12215 (95%-conf.int. 0.12215 - 0.12215)
+---------------------------------------------
+1 ROUGE-L Average_R: 0.12409 (95%-conf.int. 0.12409 - 0.12409)
+1 ROUGE-L Average_P: 0.82639 (95%-conf.int. 0.82639 - 0.82639)
+1 ROUGE-L Average_F: 0.21578 (95%-conf.int. 0.21578 - 0.21578)
+---------------------------------------------
+1 ROUGE-W-1.2 Average_R: 0.03895 (95%-conf.int. 0.03895 - 0.03895)
+1 ROUGE-W-1.2 Average_P: 0.52120 (95%-conf.int. 0.52120 - 0.52120)
+1 ROUGE-W-1.2 Average_F: 0.07248 (95%-conf.int. 0.07248 - 0.07248)
+---------------------------------------------
+1 ROUGE-S* Average_R: 0.01611 (95%-conf.int. 0.01611 - 0.01611)
+1 ROUGE-S* Average_P: 0.71873 (95%-conf.int. 0.71873 - 0.71873)
+1 ROUGE-S* Average_F: 0.03151 (95%-conf.int. 0.03151 - 0.03151)
+---------------------------------------------
+1 ROUGE-SU* Average_R: 0.01634 (95%-conf.int. 0.01634 - 0.01634)
+1 ROUGE-SU* Average_P: 0.72057 (95%-conf.int. 0.72057 - 0.72057)
+1 ROUGE-SU* Average_F: 0.03196 (95%-conf.int. 0.03196 - 0.03196)

evaluation/all_models.py

@@ -1,19 +1,19 @@
 from pyrouge import Rouge155
 
-def main(system_file, model_file):
+def main():# system_file, model_file):
   r = Rouge155()
 
-  r.system_dir = "../data/smmry_tosdr_corpus/smmry_input/"
-  r.model_dir = "../data/smmry_tosdr_corpus/smmry_output/"
-  r.system_filename_pattern = '(' + system_file + ').txt'
+  r.system_dir = "../model2/Rovio/"
+  r.model_dir = "../model2/1NN_Summary/"
+  r.system_filename_pattern = '(rovio).txt'
   r.model_filename_pattern = '#ID#.txt'
 
   output = r.convert_and_evaluate()
-  with open(system_file + "_ROUGE.txt", "w") as f:
-    f.write(output)
+  print output
   # output_dict = r.output_to_dict(output)
 
 if __name__ == "__main__":
-  system_file = sys.argv[1]
-  model_file = sys.argv[2]
-  main(system_file, model_file)
+  # system_file = sys.argv[1]
+  # model_file = sys.argv[2]
+  # main(system_file, model_file)
+  main()

evaluation/amazon_ROUGE.txt

@@ -0,0 +1,29 @@
+The Service includes all of the Instagram products, features, applications, services, technologies, and software that we provide to advance Instagram's mission: To bring you closer to the people and things you love.
+Learn more in the Data Policy.
+Developing and using technologies that help us consistently serve our growing community.
+Organizing and analyzing information for our growing community is central to our Service.
+Technologies like artificial intelligence and machine learning give us the power to apply complex processes across our Service.
+Automated technologies also help us ensure the functionality and integrity of our Service.
+Providing consistent and seamless experiences across other Facebook Company Products.
+Instagram is part of the Facebook Companies, which share technology, systems, insights, and information-including the information we have about you (learn more in the Data Policy) in order to provide services that are better, safer, and more secure.
+So, we need you to commit to a few restrictions in order to be part of the Instagram community.
+You must be at least 13 years old.
+You must not be prohibited from receiving any aspect of our Service under applicable laws or engaging in payments related Services if you are on an applicable denied party listing.
+We must not have previously disabled your account for violation of law or any of our policies.
+You must not be a convicted sex offender.
+You don't have to disclose your identity on Instagram, but you must provide us with accurate and up to date information (including registration information).
+Also, you may not impersonate someone you aren't, and you can't create an account for someone else unless you have their express permission.
+You can't do anything unlawful, misleading, or fraudulent or for an illegal or unauthorized purpose.
+Instead, when you share, post, or upload content that is covered by intellectual property rights (like photos or videos) on or in connection with our Service, you hereby grant to us a non-exclusive, royalty-free, transferable, sub-licensable, worldwide license to host, use, distribute, modify, run, copy, publicly perform or display, translate, and create derivative works of your content (consistent with your privacy and application settings).
+You give us permission to show your username, profile picture, and information about your actions (such as likes) or relationships (such as follows) next to or in connection with accounts, ads, offers, and other sponsored content that you follow or engage with that are displayed on Facebook Products, without any compensation to you.
+We will also respect your ad settings.
+You can learn more here about your ad settings.
+You agree that we can download and install updates to the Service on your device.
+If you use content covered by intellectual property rights that we have and make available in our Service (for example, images, designs, videos, or sounds we provide that you add to content you create or share), we retain all rights to our content (but not yours).
+If you believe your account has been terminated in error, or you want to disable or permanently delete your account, consult our Help Center.
+Content you delete may persist for a limited period of time in backup copies and will still be visible where others have shared it.
+You agree that we won't be responsible ("liable") for any lost profits, revenues, information, or data, or consequential, special, indirect, exemplary, punitive, or incidental damages arising out of or related to these Terms, even if we know they are possible.
+Class actions and class arbitrations are not permitted; you and we may bring a claim only on your own behalf and cannot seek relief that would affect other Instagram users.
+All other claims (or requests for relief) remain subject to this provision.
+You can opt out of this provision within 30 days of the date that you agreed to these Terms.
+For any claim that is not arbitrated or resolved in small claims court, you agree that it will be resolved exclusively in the U.S. District Court for the Northern District of California or a state court located in San Mateo County.

evaluation/rouge_score_model_2.py

@@ -0,0 +1,2 @@
+“Auxiliary Product” means any product you can interact with or operate using an Alexa Enabled Product, including Alexa Gadgets and smart home devices such as lights, switches, and thermostats.
+Amazon processes and retains your Alexa Interactions, such as your voice inputs, music playlists, and your Alexa to-do and shopping lists, in the cloud to provide, personalize, and improve our services.

model2/1NN_Summary/instagram_summary.txt

@@ -0,0 +1,17 @@
+WE EXPLAIN SOME EXCEPTIONS AND HOW YOU CAN OPT OUT OF ARBITRATION BELOW.
+The Service includes all of the Instagram products, features, applications, services, technologies, and software that we provide to advance Instagram's mission: To bring you closer to the people and things you love.
+The Service is made up of the following aspects (the Service):
+So we build systems that try to understand who and what you and others care about, and use that information to help you create, find, join, and share in experiences that matter to you.
+Part of that is highlighting content, features, offers, and accounts you might be interested in, and offering ways for you to experience Instagram, based on things you and others do on and off Instagram.
+A big part of our Service is creating and using cutting-edge technologies that help us personalize, protect, and improve our Service on an incredibly large scale for a broad global community.
+Technologies like artificial intelligence and machine learning give us the power to apply complex processes across our Service.
+Instagram is part of the Facebook Companies, which share technology, systems, insights, and information-including the information we have about you (learn more in the Data Policy) in order to provide services that are better, safer, and more secure.
+We also provide ways to interact across the Facebook Company Products that you use, and designed systems to achieve a seamless and consistent experience across the Facebook Company Products.
+To provide our global Service, we must store and transfer data across our systems around the world, including outside of your country of residence.
+This infrastructure may be owned or operated by Facebook Inc., Facebook Ireland Limited, or their affiliates.
+Connecting you with brands, products, and services in ways you care about.
+We use data from Instagram and other Facebook Company Products, as well as from third-party partners, to show you ads, offers, and other sponsored content that we believe will be meaningful to you.
+And we try to make that content as relevant as all your other experiences on Instagram.
+We use the information we have to study our Service and collaborate with others on research to make our Service better and contribute to the well-being of our community.
+Instead, when you share, post, or upload content that is covered by intellectual property rights (like photos or videos) on or in connection with our Service, you hereby grant to us a non-exclusive, royalty-free, transferable, sub-licensable, worldwide license to host, use, distribute, modify, run, copy, publicly perform or display, translate, and create derivative works of your content (consistent with your privacy and application settings).
+You give us permission to show your username, profile picture, and information about your actions (such as likes) or relationships (such as follows) next to or in connection with accounts, ads, offers, and other sponsored content that you follow or engage with that are displayed on Facebook Products, without any compensation to you.

model2/Perceptron_Summary/amazon.txt

@@ -0,0 +1,86 @@
+Effective September 24, 2018.
+Reddit powers hundreds of thousands of distinct online communities.
+This User Agreement and your conduct make that possible.
+This Reddit User Agreement ("Terms") applies to your access to and use of the websites, mobile apps, widgets, and other online products and services (collectively, the "Services") provided by Reddit, Inc. ("Reddit," "we," or "us").
+By accessing or using our Services, you agree to be bound by these Terms.
+If you do not agree to these Terms, you may not access or use our Services.
+Children under the age of 13 are not allowed to create an account or otherwise use the Services.
+Additionally, if you are in the European Economic Area, you must be over the age required by the laws of your country to create an account or otherwise use the Services, or we need to have received verifiable consent from your parent or legal guardian.
+If you are accepting these Terms on behalf of another legal entity, including a business or a government, you represent that you have full legal authority to bind such entity to these terms.
+Reddit grants you a personal, non-transferable, non-exclusive, revocable, limited license to use and access the Services solely as permitted by these Terms.
+We reserve all rights not expressly granted to you by these Terms.
+license, sell, transfer, assign, distribute, host, or otherwise commercially exploit the Services or Content;
+modify, prepare derivative works of, disassemble, decompile, or reverse engineer any part of the Services or Content; or
+access the Services or Content in order to build a similar or competitive website, product, or service, except as permitted under the Reddit API Terms of Use.
+We reserve the right to modify, suspend, or discontinue the Services (in whole or in part) at any time, with or without notice to you.
+Any future release, update, or other addition to functionality of the Services will be subject to these Terms, which may be updated from time to time.
+You agree that we will not be liable to you or to any third party for any modification, suspension, or discontinuation of the Services or any part thereof.
+Your Reddit Account and Account Security
+To use certain features of our Services, you may be required to create a Reddit account (an "Account") and provide us with a username, password, and certain other information about yourself as set forth in the Privacy Policy.
+You must maintain the security of your Account and promptly notify Reddit if you discover or suspect that someone has accessed your Account without your permission.
+We recommend that you use a strong password that is used only with the Services.
+The Services may contain information, text, links, graphics, photos, videos, or other materials (“Content”), including Content created with or submitted to the Services by you or through your Account (“Your Content”).
+We take no responsibility for and we do not expressly or implicitly endorse any of Your Content.
+Because you alone are responsible for Your Content, you may expose yourself to liability if you post or share Content without all necessary rights.
+When Your Content is created with or submitted to the Services, you grant us a worldwide, royalty-free, perpetual, irrevocable, non-exclusive, transferable, and sublicensable license to use, copy, modify, adapt, prepare derivative works from, distribute, perform, and display Your Content and any name, username, voice, or likeness provided in connection with Your Content in all media formats and channels now known or later developed.
+This license includes the right for us to make Your Content available for syndication, broadcast, distribution, or publication by other companies, organizations, or individuals who partner with Reddit.
+You also agree that we may remove metadata associated with Your Content, and you irrevocably waive any claims and assertions of moral rights or attribution with respect to Your Content.
+Any ideas, suggestions, and feedback about Reddit or our Services that you provide to us are entirely voluntary, and you agree that Reddit may use such ideas, suggestions, and feedback without compensation or obligation to you.
+Although we have no obligation to screen, edit, or monitor Your Content, we may, in our sole discretion, delete or remove Your Content at any time and for any reason, including for a violation of these Terms, a violation of our Content Policy, or if you otherwise create liability for us.
+Third-Party Content, Advertisements and Promotions
+The Services may contain links to third-party websites, products, or services, which may be posted by advertisers, our affiliates, our partners, or other users (“Third-Party Content”).
+Third-Party Content is not under our control, and we are not responsible for any of their websites, products, or services.
+Your use of Third-Party Content is at your own risk and you should make any investigation you feel necessary before proceeding with any transaction in connection with such Third-Party Content.
+The type, degree, and targeting of advertisements are subject to change, and you acknowledge and agree that we may place advertisements in connection with the display of any Content or information on the Services, including Your Content.
+The terms of your promotion must specifically state that the promotion is not sponsored by, endorsed by, or associated with Reddit and the rules for your promotion must require each entrant or participant to release Reddit from any liability related to the promotion.
+When accessing or using the Services, you must respect others and their rights, including by following these Terms and the Content Policy, so that we all may continue to use and enjoy the Services.
+We support the responsible reporting of security vulnerabilities.
+To report a security issue, please send an email to security@reddit.com.
+Upload, transmit, or distribute to or through the Services any computer viruses, worms, or other software intended to interfere with the intended operation of a computer system or data;
+Use the Services to harvest, collect, gather or assemble information or data regarding the Services or users of the Services except as permitted in these Terms or in a separate agreement with Reddit;
+Use the Services in any manner that could interfere with, disrupt, negatively affect, or inhibit other users from fully enjoying the Services or that could damage, disable, overburden, or impair the functioning of the Services in any manner;
+Intentionally negate any user's actions to delete or edit their Content on the Services; or
+Access, query, or search the Services with any automated system, other than through our published interfaces and pursuant to their applicable terms.
+However, we conditionally grant permission to crawl the Services for the sole purpose of and solely to the extent necessary for creating publicly available searchable indices of the materials subject to the parameters set forth in our robots.txt file.
+7.
+Moderators
+Moderating a subreddit is an unofficial, voluntary position that may be available to users of the Services.
+We are not responsible for actions taken by the moderators.
+We recognize that moderation can take some work, so we may change the features or abilities associated with moderating from time to time without prior notice.
+We reserve the right to revoke or limit a user’s ability to moderate at any time and for any reason or no reason, including for a breach of these Terms.
+You may not enter into any agreement with a third party on behalf of Reddit, or any subreddits that you moderate, without our written approval;
+You may not perform moderation actions in return for any form of compensation or favor from third parties;
+If you have access to non-public information as a result of moderating a subreddit, you will use such information only in connection with your performance as a moderator; and
+You may create and enforce rules for the subreddits you moderate, provided that such rules do not conflict with these Terms, our Content Policy, and the Moderator Guidelines for Healthy Communities.
+Reddit reserves the right, but has no obligation, to overturn any action or decision of a moderator if Reddit believes that such action or decision is not in the interest of Reddit or the Reddit community.
+Reddit respects the intellectual property of others and requires that users of our Services do the same.
+We have a policy that includes the removal of any infringing materials from the Services and for the termination, in appropriate circumstances, of users of our Services who are repeat infringers.
+If you believe that anything on our Services infringes a copyright that you own or control, you may notify Reddit’s Designated Agent by filling out our DMCA Report Form or by contacting:
+San Francisco, CA 94102
+copyright@reddit.com
+§512(g)(3) for the requirements of a proper counter notification.
+However, premium features, including Reddit Premium and Virtual Goods, which include Coins, may be available for purchase on certain of our Services.
+In addition to these terms, by purchasing or using Reddit Premium or our Virtual Goods, you further agree to the Reddit Premium and Virtual Goods Agreement.
+If you submit your Payment Information, you agree to pay all costs that you incur, and you give us permission to charge you when payment is due for an amount that includes these costs and any applicable taxes and fees.
+Except to the extent prohibited by law, you agree to defend, indemnify, and hold us, our licensors, our third party service providers and our officers, employees, licensors, and agents (the “Reddit Entities”) harmless, including costs and attorneys’ fees, from any claim or demand made by any third party due to or arising out of (a) your use of the Services, (b) your violation of these Terms, (c) your violation of applicable laws or regulations, or (d) Your Content.
+We reserve the right to control the defense of any matter for which you are required to indemnify us, and you agree to cooperate with our defense of these claims.
+THE SERVICES ARE PROVIDED "AS IS" AND "AS AVAILABLE" WITHOUT WARRANTIES OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, IMPLIED WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, AND NON-INFRINGEMENT.
+REDDIT, ITS LICENSORS, AND ITS THIRD PARTY SERVICE PROVIDERS DO NOT WARRANT THAT THE SERVICES ARE ACCURATE, COMPLETE, RELIABLE, CURRENT, OR ERROR FREE.
+REDDIT DOES NOT CONTROL, ENDORSE, OR TAKE RESPONSIBILITY FOR ANY CONTENT AVAILABLE ON OR LINKED TO THE SERVICES OR THE ACTIONS OF ANY THIRD PARTY OR USER, INCLUDING MODERATORS.
+WHILE REDDIT ATTEMPTS TO MAKE YOUR ACCESS TO AND USE OF OUR SERVICES SAFE, WE DO NOT REPRESENT OR WARRANT THAT OUR SERVICES OR SERVERS ARE FREE OF VIRUSES OR OTHER HARMFUL COMPONENTS.
+IN NO EVENT AND UNDER NO THEORY OF LIABILITY, INCLUDING CONTRACT, TORT, NEGLIGENCE, STRICT LIABILITY, WARRANTY, OR OTHERWISE, WILL THE REDDIT ENTITIES BE LIABLE TO YOU FOR ANY INDIRECT, CONSEQUENTIAL, EXEMPLARY, INCIDENTAL, SPECIAL, OR PUNITIVE DAMAGES, OR LOST PROFITS ARISING FROM OR RELATING TO THESE TERMS OR THE SERVICES, INCLUDING THOSE ARISING FROM OR RELATING TO CONTENT MADE AVAILABLE ON THE SERVICES THAT IS ALLEGED TO BE DEFAMATORY, OFFENSIVE, OR ILLEGAL.
+ACCESS TO, AND USE OF, THE SERVICES IS AT YOUR OWN DISCRETION AND RISK, AND YOU WILL BE SOLELY RESPONSIBLE FOR ANY DAMAGE TO YOUR DEVICE OR COMPUTER SYSTEM, OR LOSS OF DATA RESULTING THEREFROM.
+IN NO EVENT WILL THE AGGREGATE LIABILITY OF THE REDDIT ENTITIES EXCEED THE GREATER OF ONE HUNDRED U.S.
+DOLLARS ($100) OR ANY AMOUNT YOU PAID REDDIT IN THE PREVIOUS SIX MONTHS FOR THE SERVICES GIVING RISE TO THE CLAIM.
+THE LIMITATIONS OF THIS SECTION WILL APPLY TO ANY THEORY OF LIABILITY, INCLUDING THOSE BASED ON WARRANTY, CONTRACT, STATUTE, TORT (INCLUDING NEGLIGENCE) OR OTHERWISE, AND EVEN IF THE REDDIT ENTITIES HAVE BEEN ADVISED OF THE POSSIBILITY OF ANY SUCH DAMAGE, AND EVEN IF ANY REMEDY SET FORTH HEREIN IS FOUND TO HAVE FAILED ITS ESSENTIAL PURPOSE.
+THE FOREGOING LIMITATION OF LIABILITY WILL APPLY TO THE FULLEST EXTENT PERMITTED BY LAW IN THE APPLICABLE JURISDICTION.
+We want you to enjoy Reddit, so if you have an issue or dispute, you agree to raise it and try to resolve it with us informally.
+You can contact us with feedback and concerns here or by emailing us at contact@reddit.com.
+All disputes related to these Terms or the Services will be brought solely in the federal or state courts located in San Francisco, California.
+If the changes, in our sole discretion, are material, we may also notify you by sending an email to the address associated with your Account (if you have chosen to provide an email address) or by otherwise providing notice through our Services.
+By continuing to access or use the Services on or after the Effective Date of the revised Terms, you agree to be bound by the revised Terms.
+If you do not agree to the revised Terms, you must stop accessing and using our Services before the changes become effective.
+To the extent any Additional Terms conflict with these Terms, the Additional Terms govern with respect to your use of the corresponding Service.
+If you stop using the Services without deactivating your Accounts, your Accounts may be deactivated due to prolonged inactivity.
+If any provision of these Terms is, for any reason, held to be illegal, invalid or unenforceable, the rest of the Terms will remain in effect.
+You may not assign or transfer any of your rights or obligations under these Terms without our consent.

model2/Perceptron_Summary/atlassian.txt

@@ -0,0 +1 @@
+Rovio retains all right, title and interest in and to the Services, including, but not limited to, all copyrights, trademarks, trade secrets, trade names, proprietary rights, patents, titles, computer codes, audiovisual effects, themes, characters, character names, stories, dialog, settings, artwork, sound effects, musical works, gameplay recordings made using the Services, moral rights, whether registered or not and all applications thereof.

model2/Perceptron_Summary/instagram.txt

@@ -0,0 +1,93 @@
+User Instructions:
+Keep all co-players and audiences in mind when chatting.
+Be courteous and considerate of everybody.
+Do not bully or harass other players.
+
+Protects Everybody:
+No hate speech of any kind is allowed.
+
+User Rights (Negative):
+You agree to not use the service to submit or link to any content which is defamatory, abusive, hateful, threatening, libelious, spam or spam-like, likely to offend, contains adult, nudity or objectionable content, contains personal information of others, or is racially, sexually, religiously, or other objectionable or offensive, risks copyright infringement, encourages unlawful activity, or otherwise violates any laws.
+At our discretion, our representative or technology may monitor and/or record your interaction with the service or communications (including without limitation chat text) when you are using the Service.
+You are granting us with a non-exclusive, permanent, irrevocable, unlimited license to use, publish, or re-publish your content in connection with the service.
+You acknowledge and agree that you have no expectation of privacy concerning the transmission of any content, including without limitation chat text or voice communications.
+You will fully cooperate with us to investigate any suspected unlawful, fraudulent or improper activity, including, without limitation, granting us access to any password-protected portions of your account.
+By accepting these Rules, you hereby provide your irrevocable consent to such monitoring and recording.
+
+User Rights (Positive):
+You retain copyright over the content.
+You are solely responsible for your interactions with other users and any other parties with whom you interact through the service.
+
+Company Rights (Positive):
+We reserve the right to remove or modify any content submitted for any reason without explanation.
+We reserve the right to take action against any account with the service at any time.
+If we would monitor the service, we still assume no responsibility for user content and assume no obligation to modify or remove any inappropriate user content.
+We have the right, but not the obligation, in our sole discretion to edit, refuse to post, or remove any user content.
+We reserve the right, but have no obligation, to become involved in any way with these disputes.
+All content you submit or upload may be reviewed by the staff members or sent to third-party verification services (including, but not limited to, spam prevention services).
+Requests for content to be removed or modified will be undertaken only at our discretion.
+
+Protects company:
+Attempt to, or harass, abuse, or harm, or advocate of incite harassment, abuse, or harm of another person, group, including Rovio employees, including its customer service representatives is violation of theses Rules.
+If you have a dispute with one or more users, you release us (and our officers, directors, agents, subsidiaries, joint ventures and employees) from claims, demands and damages (actual and consequential) of every kind and nature, known and unknown, arising out of or in any way connected with such disputes.
+
+Warnings:
+We do not, and cannot, pre-screen or monitor all content submitted to the service.
+Your use of the service is at your own risk.
+By using the Service, you may be exposed to user content that is offensive, indecent of otherwise not in line with your expectations, again at your risk.
+
+Summarizebot https://www.summarizebot.com/api/99fac7a670cd4df182105a381da679df.html
+:
+These terms of service (“TOS”) apply to you and Rovio Entertainment Corporation, address Keilaranta 7, 02150 Espoo, Finland, ("Rovio”) regarding your use of Rovio´s games, websites, discussion forums and related services ("Services").
+
+For United States residents, these TOS contain a binding arbitration clause in Article 8 and a class-action waiver that affects your rights about how to resolve disputes.
+
+Unless otherwise specified by a component of an applicable Service, the Services are free to use or download but may contain features that may allow you to make purchases within the Services.
+
+If you access the Services from a social networking site ("SNS"), such as Facebook, you agree to comply with its terms of service as well as these TOS.
+
+You agree that you have no right or title in or to any content that appears in the Service, including, but not limited to, the Virtual Items or currency appearing in or originating from the Services, whether earned in the Services or purchased from Rovio or third parties.
+
+Rovio may license to you certain virtual goods to be used within the Service and which you may purchase with "real world" money or which you may earn or redeem via gameplay ("Virtual Items").
+
+You agree that you will not, under any circumstances: Services may include links to third-party services (including, but not limited to, advertisements displayed by third parties) and/or the third-party services may be made available to you via Services.
+
+These services may include, but are not limited to gameplay recording and sharing, social media connectivity and advertisements.
+
+These services are subject to respective third party terms and conditions.
+
+Please read these third-party terms and conditions, carefully as they constitute an agreement between you and the relevant third-party service provider to which Rovio is not a party.
+
+Rovio reserves the right to delete your Account if Rovio observes no activity by you in relation to the Account for 180 days or more.
+
+Rovio assumes no responsibility for the conduct of other users of the Services and assumes no responsibility for monitoring the Services for inappropriate content or conduct.
+
+Rovio may utilize technology to monitor and/or record your interactions with the Services or communications (including, but not limited to, chat text) when you are using the Services.
+
+If at any time Rovio chooses, at its sole discretion, to monitor the Services, Rovio nonetheless assumes no responsibility for content made available by users of the Services, and Rovio assumes no obligation to modify or remove any inappropriate content.
+
+Rovio also reserves the right in its sole and exclusive discretion to assume responsibility for all arbitration costs imposed by the AAA.
+
+For more information on AAA, its Rules and Procedures, and how to file an arbitration claim, you may call AAA at 800-778-7879 or visit the AAA website at www.adr.org.
+
+To begin an arbitration proceeding, you must send a letter to: Rovio Entertainment Corporation, ATTN: Legal Department, Keilaranta 7, 02150 Espoo, Finland requesting arbitration and describing your claim.
+
+Rovio may limit, suspend or terminate the Services, or portions thereof, and take technical and legal steps to prevent users from accessing the Services if Rovio believes they are creating risk or possible legal liabilities, infringing intellectual property rights of third parties, or not acting in accordance with the letter or spirit of these TOS.
+
+Rovio does not warrant against interference with your enjoyment of the Services; that the Services will meet your requirements; that operation of the Services will be uninterrupted or error-free; that the Services will interoperate or be compatible with any other services; or, that any errors in the Services will be corrected.
+
+Notices sent to the specified address will reach Rovio´s registered DMCA agent.
+
+Rovio may link to third-party websites or services from the Services.
+
+You understand that Rovio makes no promises regarding any content, goods or services provided by such third parties and, you understand Rovio does not endorse them.
+
+When Rovio updates these TOS, Rovio will take appropriate measures to inform you via the Services or otherwise, in accordance with the significance of the changes Rovio makes.
+
+If you are a resident outside the United States, you agree that all disputes between you and Rovio shall be governed by the laws of Finland, regardless of conflict of law provisions.
+
+You agree that any claim or dispute you may file against Rovio must be resolved exclusively by a court located in Espoo, Finland.
+
+If the jurisdiction of your domicile prohibits Rovio from enforcing the governing law provision, nothing in these TOS limits your rights based on the laws governing your domicile.
+
+This TOS and Privacy Notice set out the entire agreement between you and Rovio regarding the Services and supersede all earlier agreements and understandings between you and Rovio.

model2/Perceptron_Summary/reddit.txt

@@ -0,0 +1,2 @@
+Amazon processes and retains your Alexa Interactions, such as your voice inputs, music playlists, and your Alexa to-do and shopping lists, in the cloud to provide, personalize, and improve our services.
+For any Amazon-Processed Purchase that is a subscription to a Third Party Service, (i) we or the third party may cancel the subscription at any time, for example, if the applicable service is no longer available, in which case you will receive a prorated refund, and(ii) terms and prices may change from time to time, effective as of the beginning of the next subscription term.

model2/Perceptron_Summary/rovio.txt

@@ -0,0 +1,9 @@
+Except as otherwise expressly permitted in these Terms, you will not: (a) reproduce, modify, adapt or create derivative works of the Cloud Products; (b) rent, lease, distribute, sell, sublicense, transfer or provide access to the Cloud Products to a third party; (c) use the Cloud Products for the benefit of any third party; (d) incorporate any Cloud Products into a product or service you provide to a third party; (e) interfere with or otherwise circumvent mechanisms in the Cloud Products intended to limit your use; (f) reverse engineer, disassemble, decompile, translate or otherwise seek to obtain or derive the source code, underlying ideas, algorithms, file formats or non-public APIs to any Cloud Products, except to the extent expressly permitted by applicable law (and then only upon advance notice to us); (g) remove or obscure any proprietary or other notices contained in any Cloud Product; (h) use the Cloud Products for competitive analysis or to build competitive products; (i) publicly disseminate information regarding the performance of the Cloud Products; or (j) encourage or assist any third party to do any of the foregoing.
+You will defend, indemnify and hold harmless us (and our Affiliates, officers, directors, agents and employees) from and against any and all claims, costs, damages, losses, liabilities and expenses (including reasonable attorneys’ fees and costs) resulting from any claim arising from or related to (i) your breach of Section 2.3 (End User Consent) or any claims or disputes brought by your End Users arising out of their use of Cloud Products, (ii) your breach (or alleged breach) of Sections 5.2 (Your Data Compliance Obligations) or 5.3 (No Sensitive Data); or (iii) Your Materials.
+Notwithstanding the foregoing, if you have obtained an exemption from relevant taxes or duties as of the time such taxes or duties are levied or assessed, you may provide us with such exemption information, and we will use reasonable efforts to provide you with invoicing documents designed to enable you to obtain a refund or credit from the relevant revenue authority, if such a refund or credit is available.
+Either party may terminate these Terms (including all related Orders) if the other party (a) fails to cure any material breach of these Terms within thirty (30) days after notice; (b) ceases operation without a successor; or (c) seeks protection under any bankruptcy, receivership, trust deed, creditors’ arrangement, composition or comparable proceeding, or if any such proceeding is instituted against that party (and not dismissed within sixty (60) days thereafter).
+The following provisions will survive any termination or expiration of these Terms: Sections 3.3 (Restrictions), 5.4 (Your Indemnity), 6.1 (Third-Party Products), 9.4 (Payment), 11 (Taxes not included), 14 (Evaluations, trials, and betas) (disclaimers and use restrictions only), 15 (IP Rights in the Cloud Products and Feedback), 16 (Confidentiality), 17 (Term and Termination), 18.4 (Warranty Disclaimer), 19 (Limitations of Liability), 20 (IP Indemnification) (but solely with respect to claims arising from your use of Cloud Products during the Subscription Term), 22 (Dispute Resolution) and 26 (General Provisions).
+We will defend you against any claim brought against you by a third party alleging that the Cloud Products, when used as authorized under these Terms, infringe a patent right granted in the United States, Australia or a member nation of the European Union or a copyright registered in such a jurisdiction (a “Claim”), and we will indemnify you and hold you harmless against any damages and costs finally awarded on the Claim by a court of competent jurisdiction or agreed to via settlement executed by us (including reasonable attorneys’ fees), provided that we have received from you: (a) prompt written notice of the Claim (but in any event notice in sufficient time for us to respond without prejudice); (b) reasonable assistance in the defense and investigation of the Claim, including providing us a copy of the Claim, all relevant evidence in your possession, custody, or control, and cooperation with evidentiary discovery, litigation, and trial, including making witnesses within your employ or control available for testimony; and (c) the exclusive right to control and direct the investigation, defense, and settlement (if applicable) of the Claim.
+Our indemnification obligations above do not apply: (1) if the total aggregate fees we receive with respect to your subscription to a Cloud Product in the twelve (12) month period immediately preceding the Claim is less than US$50,000; (2) if the Cloud Product is modified by any party other than us, but solely to the extent the alleged infringement is caused by such modification; (3) if the Cloud Product is used in combination with any non-Atlassian product, software, service or equipment, but solely to the extent the alleged infringement is caused by such combination; (4) to unauthorized use of Cloud Products; (5) to any Claim arising as a result of (y) Your Data or circumstances covered by your indemnification obligations in Section 5.4 (Your Indemnity) or (z) any third-party deliverables or components contained with the Cloud Products or (6) if you settle or make any admissions with respect to a Claim without our prior written consent.
+Each party irrevocably agrees that any legal action, suit or proceeding arising out of or related to these Terms must be brought solely and exclusively in, and will be subject to the service of process and other applicable procedural rules of, the State or Federal court in San Francisco, California, USA, and each party irrevocably submits to the sole and exclusive personal jurisdiction of the courts in San Francisco, California, USA, generally and unconditionally, with respect to any action, suit or proceeding brought by it or against it by the other party.
+Neither party will be liable to the other for any delay or failure to perform any obligation under these Terms (except for a failure to pay fees) if the delay or failure is due to events which are beyond the reasonable control of such party, such as a strike, blockade, war, act of terrorism, riot, natural disaster, failure or diminishment of power or telecommunications or data networks or services, or refusal of a license by a government agency.

model2/Perceptron_Summary/twitter.txt

@@ -0,0 +1,3 @@
+The Service includes all of the Instagram products, features, applications, services, technologies, and software that we provide to advance Instagram's mission: To bring you closer to the people and things you love.
+Instagram is part of the Facebook Companies, which share technology, systems, insights, and information-including the information we have about you (learn more in the Data Policy) in order to provide services that are better, safer, and more secure.
+Instead, when you share, post, or upload content that is covered by intellectual property rights (like photos or videos) on or in connection with our Service, you hereby grant to us a non-exclusive, royalty-free, transferable, sub-licensable, worldwide license to host, use, distribute, modify, run, copy, publicly perform or display, translate, and create derivative works of your content (consistent with your privacy and application settings).

model2/Rovio/rovio.txt

@@ -0,0 +1,3 @@
+When Your Content is created with or submitted to the Services, you grant us a worldwide, royalty-free, perpetual, irrevocable, non-exclusive, transferable, and sublicensable license to use, copy, modify, adapt, prepare derivative works from, distribute, perform, and display Your Content and any name, username, voice, or likeness provided in connection with Your Content in all media formats and channels now known or later developed.
+Except to the extent prohibited by law, you agree to defend, indemnify, and hold us, our licensors, our third party service providers and our officers, employees, licensors, and agents (the “Reddit Entities”) harmless, including costs and attorneys’ fees, from any claim or demand made by any third party due to or arising out of (a) your use of the Services, (b) your violation of these Terms, (c) your violation of applicable laws or regulations, or (d) Your Content.
+IN NO EVENT AND UNDER NO THEORY OF LIABILITY, INCLUDING CONTRACT, TORT, NEGLIGENCE, STRICT LIABILITY, WARRANTY, OR OTHERWISE, WILL THE REDDIT ENTITIES BE LIABLE TO YOU FOR ANY INDIRECT, CONSEQUENTIAL, EXEMPLARY, INCIDENTAL, SPECIAL, OR PUNITIVE DAMAGES, OR LOST PROFITS ARISING FROM OR RELATING TO THESE TERMS OR THE SERVICES, INCLUDING THOSE ARISING FROM OR RELATING TO CONTENT MADE AVAILABLE ON THE SERVICES THAT IS ALLEGED TO BE DEFAMATORY, OFFENSIVE, OR ILLEGAL.

model2/SVC_Summary/amazon.txt

@@ -0,0 +1,3 @@
+Rovio retains all right, title and interest in and to the Services, including, but not limited to, all copyrights, trademarks, trade secrets, trade names, proprietary rights, patents, titles, computer codes, audiovisual effects, themes, characters, character names, stories, dialog, settings, artwork, sound effects, musical works, gameplay recordings made using the Services, moral rights, whether registered or not and all applications thereof.
+Rovio does not make, and hereby disclaims any and all express, implied or statutory warranties, including implied warranties of condition, uninterrupted use, accuracy of data (including, but not limited to, location data), merchantability, satisfactory quality, fitness for a particular purpose, non-infringement of third-party rights, and warranties (if any) arising in the course of dealing, usage, or trade practices.
+In no way will Rovio be liable for special, incidental or consequential damages resulting from access, use or malfunction of the Services, including but not limited to, damages to property, loss of goodwill, device failure or malfunction and, to the extent permitted by law, damages for personal injuries, property damage, lost profits or punitive damages from any causes of action arising out of or related to these TOS or the Services, whether arising in tort (including negligence), contract, strict liability or otherwise and whether or not Rovio has been advised of the possibility of such damages.

model2/SVC_Summary/atlassian.txt

@@ -0,0 +1,10 @@
+These Terms of Service (“Terms”) govern your access to and use of our services, including our various websites, SMS, APIs, email notifications, applications, buttons, widgets, ads, commerce services, and our other covered services  (https://support.twitter.com/articles/20172501) that link to these Terms (collectively, the “Services”), and any information, text, links, graphics, photos, audio, videos, or other materials or arrangements of materials uploaded, downloaded or appearing on the Services (collectively referred to as “Content”).
+By submitting, posting or displaying Content on or through the Services, you grant us a worldwide, non-exclusive, royalty-free license (with the right to sublicense) to use, copy, reproduce, process, adapt, modify, publish, transmit, display and distribute such Content in any and all media or distribution methods (now known or later developed).
+You may not do any of the following while accessing or using the Services: (i) access, tamper with, or use non-public areas of the Services, Twitter’s computer systems, or the technical delivery systems of Twitter’s providers; (ii) probe, scan, or test the vulnerability of any system or network or breach or circumvent any security or authentication measures; (iii) access or search or attempt to access or search the Services by any means (automated or otherwise) other than through our currently available, published interfaces that are provided by Twitter (and only pursuant to the applicable terms and conditions), unless you have been specifically allowed to do so in a separate agreement with Twitter (NOTE: crawling the Services is permissible if done in accordance with the provisions of the robots.txt file, however, scraping the Services without the prior consent of Twitter is expressly prohibited); (iv) forge any TCP/IP packet header or any part of the header information in any email or posting, or in any way use the Services to send altered, deceptive or false source-identifying information; or (v) interfere with, or disrupt, (or attempt to do so), the access of any user, host or network, including, without limitation, sending a virus, overloading, flooding, spamming, mail-bombing the Services, or by scripting the creation of Content in such a manner as to interfere with or create an undue burden on the Services.
+We also reserve the right to access, read, preserve, and disclose any information as we reasonably believe is necessary to (i) satisfy any applicable law, regulation, legal process or governmental request, (ii) enforce the Terms, including investigation of potential violations hereof, (iii) detect, prevent, or otherwise address fraud, security or technical issues, (iv) respond to user support requests, or (v) protect the rights, property or safety of Twitter, its users and the public.
+If you want to reproduce, modify, create derivative works, distribute, sell, transfer, publicly display, publicly perform, transmit, or otherwise use the Services or Content on the Services, you must use the interfaces and instructions we provide, except as permitted through the Twitter Services, these Terms, or the terms provided on dev.twitter.com.
+TO THE MAXIMUM EXTENT PERMITTED BY APPLICABLE LAW, THE TWITTER ENTITIES SHALL NOT BE LIABLE FOR ANY INDIRECT, INCIDENTAL, SPECIAL, CONSEQUENTIAL OR PUNITIVE DAMAGES, OR ANY LOSS OF PROFITS OR REVENUES, WHETHER INCURRED DIRECTLY OR INDIRECTLY, OR ANY LOSS OF DATA, USE, GOODWILL, OR OTHER INTANGIBLE LOSSES, RESULTING FROM (i) YOUR ACCESS TO OR USE OF OR INABILITY TO ACCESS OR USE THE SERVICES; (ii) ANY CONDUCT OR CONTENT OF ANY THIRD PARTY ON THE SERVICES, INCLUDING WITHOUT LIMITATION, ANY DEFAMATORY, OFFENSIVE OR ILLEGAL CONDUCT OF OTHER USERS OR THIRD PARTIES; (iii) ANY CONTENT OBTAINED FROM THE SERVICES; OR (iv) UNAUTHORIZED ACCESS, USE OR ALTERATION OF YOUR TRANSMISSIONS OR CONTENT.
+These Terms of Service (“Terms”) govern your access to and use of our services, including our various websites, SMS, APIs, email notifications, applications, buttons, widgets, ads, commerce services, and our other covered services (https://support.twitter.com/articles/20172501) that link to these Terms (collectively, the “Services”), and any information, text, links, graphics, photos, audio, videos, or other materials or arrangements of materials uploaded, downloaded or appearing on the Services (collectively referred to as “Content”).
+You may not do any of the following while accessing or using the Services: (i) access, tamper with, or use non-public areas of the Services, Twitter’s computer systems, or the technical delivery systems of Twitter’s providers; (ii) probe, scan, or test the vulnerability of any system or network or breach or circumvent any security or authentication measures; (iii) access or search or attempt to access or search the Services by any means (automated or otherwise) other than through our currently available, published interfaces that are provided by Twitter (and only pursuant to the applicable terms and conditions), unless you have been specifically allowed to do so in a separate agreement with Twitter (NOTE: crawling the Services is permissible if done in accordance with the provisions of the robots.txt file, however, scraping the Services without the prior consent of Twitter is expressly prohibited); (iv) forge any TCP/IP packet header or any part of the header information in any email or posting, or in any way use the Services to send altered, deceptive or false source-identifying information; or (v) interfere with, or disrupt, (or attempt to do so), the access of any user, host or network, including, without limitation, sending a virus, overloading, flooding, spamming, mail-bombing the Services, or by scripting the creation of Content in such a manner as to interfere with or create an undue burden on the Services.
+We also reserve the right to access, read, preserve, and disclose any information as we reasonably believe is necessary to (i) satisfy any applicable law, regulation, legal process or governmental request, (ii) enforce the Terms, including investigation of potential violations hereof, (iii) detect, prevent, or otherwise address fraud, security or technical issues, (iv) respond to user support requests, or (v) protect the rights, property or safety of Twitter, its users and the public.
+If you want to reproduce, modify, create derivative works, distribute, sell, transfer, publicly display, publicly perform, transmit, or otherwise use the Services or Content on the Services, you must use the interfaces and instructions we provide, except as permitted through the Twitter Services, these Terms, or the terms provided on dev.twitter.com.

model2/SVC_Summary/instagram.txt

@@ -54,9 +54,9 @@ def main(training_files, to_summarize, output_file):
         else:
             y = np.append(y, y2, axis=0)
 
-    # clf = Perceptron(tol=-100000, random_state = 0, max_iter = 50000, penalty='l2')
+    clf = Perceptron(tol=-100000, random_state = 0, max_iter = 50000, penalty='l2')
     # clf = LinearSVC()
-    clf = KNeighborsClassifier(n_neighbors=1)
+    # clf = KNeighborsClassifier(n_neighbors=1)
 
     max_min = normalize(X)