User:Jakerylandwilliams/Potential missing entries

From Wiktionary, the free dictionary
Jump to navigation Jump to search

In general

[edit]

I am a student and mathematical linguistics researcher at the University of Vermont, and this is a living research project where we are observing our success at predicting dictionary entries that are missing from the Wiktionary. By analyzing large quantities of text from different sources, we are tracking lexical objects (in the tables below) that we refer to as phrases, which were without reference in the Wiktionary as of July 1, 2014. Any phrases that have been referenced since our access of the Wiktionary's data will appear as blue, and all that have not will appear as red. In general, we are deciding which short lists of phrases to track by two methods—the likelihood of dictionary definition (which is the result of our study), and frequency (as a baseline). For more information about this project please see our article on the arxiv.

Updates

[edit]

Update 1: The paper is live!

[edit]

The paper is live, so check it out on the arxiv:

for more information on the methods and analysis. So far it appears that several editors have inspected the tables below and added references, and as was expected almost all were propositions of the likelihood filter (only one newly referenced phrase was a frequency proposition). If you have definitions or references for any of these phrases that you would like to add, you should join the Wiktionary and become an editor.

Tables of potential missing entries

[edit]

Brief description

[edit]

The tables below contain phrases filtered out of various large corpora by two methods as part of an ongoing project aimed at detecting missing entries from a phrasal dictionary. Though this page was created on Feb. 16th, 2015, the original download of the Wiktionary entries list was made on July 1, 2014. As such, any entries below that are no longer listed as missing were successfully predicted. For more information regarding the processes by which these phrases have been extracted, please see a slightly more detailed explanation on my user page, or our article on the arxiv.

Twitter (2009): filtration by definition likelihood

[edit]
rank 2 words 3 words 4 words 5 words
1 buenos noches knock it out¹ in the same time actions speak louder then words
2 North York walk of fame on the same boat no sleep for the wicked
3 last few piece of mind about the same time every once and a while
4 holy hell seo-search engine optimization around the same time to the middle of nowhere
5 good am puta q pariu at da same time come to think about it
6 going away who the heck wat are you doing dont let the bedbugs bite
7 right up take it out wtf are you doing you get what I mean
8 go sox fim de mundo why are you doing you see what I mean
9 going well note to all hell are you doing you know who I mean
10 due out in the moment better late then never no rest for the weary
11 last bit note to myself here I go again as long as I know
12 go far check it here every now and again as soon as I know
13 right out check it at what were you doing going out on a limb
14 fuck am check it http was it just me give a person a fish
15 holy god check it now here we are again at a lost for words
16 rainy morning check it outhttp keeping an eye out de una vez por todas
17 picked out why the heck what in the butt onew kids on the block²
18 south coast memo to self de vez em qdo twice in a blue moon
19 every few reminder to self giving it a try just what the dr ordered
20 picking out how the heck pain in my ass as far as we know
¹ probably: knock it out of the park
² appears to be from: °º¤ø¤º°¨¨°º¤oNEW KIDS ON THE BLOCK º°¨¨°º¤ø

Twitter (2009): filtration by frequency

[edit]
rank 2 words 3 words 4 words 5 words
1 in the new blog post I just took the I favorited a youtube video
2 I just I just took e meu resultado foi I uploaded a youtube video
3 of the live on http other people at http just joined a video chat
4 on the I want to check this video out fiddling with my blog post
5 I love I need to just joined a video joined a video chat with
6 I have I have a a day using http I rated a youtube video
7 I think quiz and got on my way to I just voted for http
8 to be thanks for the favorited a youtube video this site just gave me
9 I was what about you I favorited a youtube add a \#twibbon to your
10 if you I think I free online adult dating the best way to get
11 at the I have to a video chat with just changed my twitter background
12 have a looking forward to uploaded a youtube video a video chat at http
13 to get acabo de completar I uploaded a youtube photos on facebook in the
14 this is I love it video chat at http check it out at http
15 and I a youtube video what do you think own video chat at http
16 but I to go to I am going to s channel on youtube http
17 are you of the day if you want to and won in \#mobsterworld http
18 it is what'll you get I wish I could live stickam stream at http
19 I need my daily twittascope just got back from on facebook in the album
20 it was if you want thanks for the rt added myself to the http

The New York Times (1987-2007): filtration by definition likelihood

[edit]
rank 2 words 3 words 4 words 5 words
1 prime example as united states in the same time when push came to shove
2 going well in united states about the same time national oceanographic and atmospheric administration
3 south jersey by united states around the same time all's well that ends well'
4 north jersey eastern united states during the same time you see what I mean
5 united front first united states roughly the same time so far as I know
6 go well a united states return to a boil take it or leave it'
7 gulf states to united states every now and again gone so far as to
8 united germany for united states at the very time love it or leave it
9 dining out senior united states nowhere to be seen as far as we're concerned
10 north brunswick of united states for the long run as bad as it gets
11 go far from united states over the long run as far as he's concerned
12 going away is a result why are you doing days of wine and roses'
13 there all and united states in the last minute as far as we know
14 picked out with united states to the last minute state of the county address
15 go all that united states until the last minute state of the state address
16 this same two united states remains to be done state of the city address
17 civil court its united states turn of the screw just a matter of time
18 good example assistant united states turn of the last be a matter of time
19 this instance but united states turn of the millennium for the grace of god
20 how am western united states once upon a mattress short end of the market

The New York Times (1987-2007): filtration by frequency

[edit]
rank 2 words 3 words 4 words 5 words
1 of the one of the in the united states at the end of the
2 in the in new york for the first time because of an editing error
3 he said the new york the new york times the new york stock exchange
4 and the some of the in new york city for the first time in
5 for the part of the at the end of he is survived by his
6 at the of new york the end of the is survived by his wife
7 in a president of the a spokesman for the an initial public offering of
8 to be the end of at the university of by the end of the
9 with the there is a one of the most the end of the year
10 that the director of the of the united states the securities and exchange commission
11 it is it was a a member of the for the first time since
12 from the according to the the rest of the for students and the elderly
13 she said in the last at the age of beloved wife of the late
14 by the the white house to the united states he said in an interview
15 it was in the united in lieu of flowers the dow jones industrial average
16 as a the university of executive director of the the executive director of the
17 he was there is no the united states and tonight and tomorrow night at
18 is a it is a is one of the in the last two years
19 with a the first time of the new york in the new york times
20 and a in the first by the end of in the last few years

Music Lyrics (1960-2007): filtration by definition likelihood

[edit]
rank 2 words 3 words 4 words 5 words
1 uh ha now or later one of a million when push come to shove
2 come aboard change of mind made up your mind come hell of high water
3 strung up over and done every now and again you see what I mean
4 fuck am forth and forth make up my mind you know that I mean
5 iced up in and down son of the gun until death do us part
6 merry little now and ever cry me a river-er that's a matter of fact
7 get much off the air have a good day it's a matter of fact
8 da same on and go on way or another what goes around comes back
9 messed around check it check for the long run you reap what you sew
10 old same stay the fuck feet on solid ground to the middle of nowhere
11 used it set the mood feet on the floor actions speak louder than lies
12 uh yeah night to day between you and I u know what I mean
13 uh on day and every what in the hell ya know what I mean
14 fall around meant to stay why are you doing you'll know what I mean
15 come one in love you you don't think so you'd know what I mean
16 out much upon the shelf for better or for y'all know what I mean
17 last few up and over once upon a dream baby know what I mean
18 used for check this shit over and forever again like it or leave it
19 number on to the brink knock-knock-knockin' on heaven's door I know what I mean
20 come prepared on the dark once upon a lifetime ain't no place like home

Music Lyrics (1960-2007): filtration by frequency

[edit]
rank 2 words 3 words 4 words 5 words
1 in the I want to la la la la la la la la la
2 and I la la la I don't want to na na na na na
3 I don't I want you na na na na on and on and on
4 on the you and me in love with you I want you to know
5 if you I don't want I want you to don't know what to do
6 to me I know you I don't know what oh oh oh oh oh
7 to be I need you I don't know why da da da da da
8 I can and I know oh oh oh oh do do do do do
9 and the I don't wanna I want to be one more chance at love
10 but I I got a know what to do I don't want to be
11 of the I know that what can I do in the middle of the
12 I can't you know I yeah yeah yeah yeah I don't give a fuck
13 for you I can see you don't have to yeah yeah yeah yeah yeah
14 when I and I don't I close my eyes I don't know what to
15 you can in your eyes you want me to all I want is you
16 I got and if you you make me feel you know I love you
17 in my the way you I just want to the middle of the night
18 all the na na na da da da da the rest of my life
19 I want don't you know if you want to no no no no no
20 that I this is the come back to me at the end of the

English Wikipedia Articles (2010): filtration by definition likelihood

[edit]
rank 2 words 3 words 4 words 5 words
1 new addition in respect to in the other hand the republic of the congo
2 african states as united states people's republic of poland so far as I know
3 less well was a result people's republic of korea going as far as to
4 south end walk of fame in the same time gone so far as to
5 dominican order central united states the republic of congo went as far as to
6 united front in united states at this same time goes as far as to
7 same-sex couples eastern united states at that same time the federal republic of yugoslavia
8 baltic states first united states approximately the same time state of the nation address
9 to york a united states about the same time as far as we know
10 new kingdom under united states around the same time just a matter of time
11 east carolina to united states during the same time due to the belief that
12 due east of united states roughly the same time as far as i'm aware
13 united church southern united states ho chi minh trail due to the fact it
14 quarter mile southeastern united states lesser general public license due to the fact he
15 end date southwestern united states in the last minute due to the fact the
16 so well and united states on the right hand as a matter of course
17 olympic medalist th united states on the left hand as a matter of policy
18 at york western united states once upon a mattress as a matter of principle
19 go go for united states o caetano do sul or something to that effect
20 teutonic order former united states turn of the screw as fate would have it

English Wikipedia Articles (2010): filtration by frequency

[edit]
rank 2 words 3 words 4 words 5 words
1 of the one of the in the united states years of age or older
2 in the part of the at the age of the average household size was
3 and the the age of a member of the were married couples living together
4 on the the end of under the age of from two or more races
5 at the according to the the end of the at the end of the
6 for the may refer to at the end of the median income for a
7 he was member of the as well as the the result of the debate
8 it is the university of years of age or of it is land and
9 with the in the early of age or older the racial makeup of the
10 as a a member of the population density was has a total area of
11 it was in the united the median age was the per capita income for
12 from the he was a as of the census and the average family size
13 the first of the population households out of which and the median income for
14 as the was born in one of the most the average family size was
15 was a end of the people per square mile had a median income of
16 in a in the late at the university of of all households were made
17 to be in addition to was one of the at an average density of
18 one of it is a for the first time males had a median income
19 during the such as the the result of the housing units at an average
20 with a the result was has a population of made up of individuals and

Project Gutenberg eBooks (1500-2010): filtration by definition likelihood

[edit]
rank 2 words 3 words 4 words 5 words
1 go if by and bye I ask your pardon handsome is that handsome does
2 come if purchasing power equivalent I crave your pardon for the grace of god
3 able man of the contrary with the other hand be that as it might
4 at york quite the contrary upon the other hand be that as it will
5 going well of united states about the same time up hill and down hill
6 there once so well as and the same time come to think about it
7 go well at a rate every now and again is no place like home
8 so am point of fact tu ne sais pas for the love of me
9 go all as you please quarter of an inch so far as i'm concerned
10 picked out so soon as quarter of an ounce you know whom I mean
11 very same it a rule quarter of an hour's you know who I mean
12 come all so to bed qu'il ne fallait pas upon the face of it
13 look well of a hurry to the expense of you understand what I mean
14 there all at the rate be the last time you see what I mean
15 how am such a hurry and the last time by the grace of heaven
16 going away just the way was the last time by the grace of the
17 going forth it all means is the last time don't know what I mean
18 get much you don't know so help me heaven be this as it may
19 why am greater or less make up my mind in a way of speaking
20 this same have no means at the heels of or something to that effect

Project Gutenberg eBooks (1500-2010): filtration by frequency

[edit]
rank 2 words 3 words 4 words 5 words
1 of the one of the for the first time at the end of the
2 and the it was a at the end of and at the same time
3 it was there was a of the united states the other side of the
4 on the out of the the end of the on the part of the
5 it is it is a the rest of the distributed proofreading team at http
6 to be I do not one of the most on the other side of
7 he was it is not on the other side at the foot of the
8 at the and it was for a long time percent of vote by party
9 for the it would be it seems to me at the head of the
10 with the he did not it would have been as a matter of course
11 he had there was no as well as the on the morning of the
12 by the and in the I am going to for the first time in
13 he said that he was as soon as the it seems to me that
14 in a it was not I should like to president of the united states
15 with a it was the as a matter of at the bottom of the
16 and I that he had on the part of I should like to know
17 that the there is no the middle of the but at the same time
18 of his that it was the head of the at the time of the
19 I have he had been at the head of had it not been for
20 and he but it was the edge of the at the end of a