{ "id": 2802, "title": "mysql dump", "url": "/competitions/cir-prospect/discussion/2802", "author_name": "", "post_date": "2012-10-03T16:03:03.600Z", "votes": null, "comment_count": 5, "views": 4022, "content": "

The readme file says there should be a file named fec.sql or fec2012.sql ready to be loaded into MySQL. Where can I find this file?

", "messages": [ { "id": "15131", "postDate": "10/03/2012 16:03:03", "content": "

The readme file says there should be a file named fec.sql or fec2012.sql ready to be loaded into MySQL. Where can I find this file?

", "rawMarkdown": "", "votes": null }, { "id": "15142", "postDate": "10/03/2012 19:54:19", "content": "

Are you looking at this file? http://www.kaggle.com/files/4553/fec2012_sql.zip

\r\n

I just pulled it down to test and the sql file should be there after you unzip.

", "rawMarkdown": "", "votes": null }, { "id": "15409", "postDate": "10/10/2012 19:54:38", "content": "

hi, i was able to download and import your sql dump.  but i got this error:

\r\n

121010 11:16:43 [ERROR] /usr/sbin/mysqld: Table './fec/fec_itemized_indiv_2012' is marked as crashed and should be repaired

\r\n

can you confirm these table sizes:

\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n
TABLE_NAMETABLE_ROWSAVG_ROW_LENGTHDATA_LENGTH
fec_itemized_cand_20125468111608732
fec_itemized_ccl_2012600647288284
fec_itemized_comm_2012132211391843376
fec_itemized_indiv_20122018465196396896504
fec_itemized_oth_201246277117882667676
fec_itemized_pas_201221177817436857308
\r\n

ie, they seem to be about the same counts as mentioned in the data dictionary, but have grown slightly?

\r\n

never mind, i seem to have been looking at an older description on the kaggle data description; these numbers are the same as in your readme.
\r\n

", "rawMarkdown": "", "votes": null }, { "id": "15411", "postDate": "10/10/2012 21:10:10", "content": "

Just checked my local copy, and counts look correct to me!

", "rawMarkdown": "", "votes": null }, { "id": "15593", "postDate": "10/15/2012 01:37:03", "content": "

i think i've mostly digested this, but a bit more error checking please...

\r\n

i am making some assumptions as to 'primary ID' and 'foreign key' reference fields in your data set.  these are captured in the table below:

\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n
ClassPID
\r\n		Fkey
\r\n
cand*candidate_id
\r\n
\r\n
comm*committee_id
\r\n
\r\n
ccl*linkage_id
\r\n
\r\n

\r\n
\r\n		candidate_idcandcandidate_id

\r\n
\r\n		committee_idcommcommittee_id
indiv*transaction_id
\r\n
\r\n

\r\n
\r\n		filer_idcommcommittee_id

\r\n
\r\n		other_idcand | comm
\r\n

\r\n
\r\n		contributor_name contribname
oth*transaction_id
\r\n
\r\n

\r\n
\r\n		filer_idcommcommittee_id

\r\n
\r\n		other_idcand | comm
\r\n

\r\n
\r\n		contributor_name contribname
pas*transaction_id
\r\n
\r\n

\r\n
\r\n		candidate_idcandcandidate_id

\r\n
\r\n		filer_idcommcommittee_id
\r\n

good so far?  if so, i'm bumping into some consistency errors of the following sorts:

\r\n\r\n

examples of these, and summary statistics are listed in the attached report.  eg, i find 241682 duplicate indiv.transaction_id ?!

\r\n

also, the _layout.xls files made me believe Indiv, Other and PAS would have \r\nnicar_amount attributes, but i find only amount ?

", "rawMarkdown": "", "votes": null }, { "id": "15663", "postDate": "10/15/2012 23:15:22", "content": "

If you're using the FEC data provided here, there are some irregularities like \\xA0 and extra commas, slashes, and quotes in some of the text fields. I had to clean up the data to get MySQL to pick it up correctly (I don't know if that's what you're using).\r\n There are tools for this in my proposal.

", "rawMarkdown": "", "votes": null } ], "comments": [ { "id": 15142, "author_name": "cjdd3b", "author_url": "", "post_date": "10/03/2012 19:54:19", "content": "

Are you looking at this file? http://www.kaggle.com/files/4553/fec2012_sql.zip

\r\n

I just pulled it down to test and the sql file should be there after you unzip.

", "votes": null, "replies": [] }, { "id": 15409, "author_name": "rikb49442", "author_url": "", "post_date": "10/10/2012 19:54:38", "content": "

hi, i was able to download and import your sql dump.  but i got this error:

\r\n

121010 11:16:43 [ERROR] /usr/sbin/mysqld: Table './fec/fec_itemized_indiv_2012' is marked as crashed and should be repaired

\r\n

can you confirm these table sizes:

\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n
TABLE_NAMETABLE_ROWSAVG_ROW_LENGTHDATA_LENGTH
fec_itemized_cand_20125468111608732
fec_itemized_ccl_2012600647288284
fec_itemized_comm_2012132211391843376
fec_itemized_indiv_20122018465196396896504
fec_itemized_oth_201246277117882667676
fec_itemized_pas_201221177817436857308
\r\n

ie, they seem to be about the same counts as mentioned in the data dictionary, but have grown slightly?

\r\n

never mind, i seem to have been looking at an older description on the kaggle data description; these numbers are the same as in your readme.
\r\n

", "votes": null, "replies": [] }, { "id": 15411, "author_name": "cjdd3b", "author_url": "", "post_date": "10/10/2012 21:10:10", "content": "

Just checked my local copy, and counts look correct to me!

", "votes": null, "replies": [] }, { "id": 15593, "author_name": "rikb49442", "author_url": "", "post_date": "10/15/2012 01:37:03", "content": "

i think i've mostly digested this, but a bit more error checking please...

\r\n

i am making some assumptions as to 'primary ID' and 'foreign key' reference fields in your data set.  these are captured in the table below:

\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n
ClassPID
\r\n		Fkey
\r\n
cand*candidate_id
\r\n
\r\n
comm*committee_id
\r\n
\r\n
ccl*linkage_id
\r\n
\r\n

\r\n
\r\n		candidate_idcandcandidate_id

\r\n
\r\n		committee_idcommcommittee_id
indiv*transaction_id
\r\n
\r\n

\r\n
\r\n		filer_idcommcommittee_id

\r\n
\r\n		other_idcand | comm
\r\n

\r\n
\r\n		contributor_name contribname
oth*transaction_id
\r\n
\r\n

\r\n
\r\n		filer_idcommcommittee_id

\r\n
\r\n		other_idcand | comm
\r\n

\r\n
\r\n		contributor_name contribname
pas*transaction_id
\r\n
\r\n

\r\n
\r\n		candidate_idcandcandidate_id

\r\n
\r\n		filer_idcommcommittee_id
\r\n

good so far?  if so, i'm bumping into some consistency errors of the following sorts:

\r\n\r\n

examples of these, and summary statistics are listed in the attached report.  eg, i find 241682 duplicate indiv.transaction_id ?!

\r\n

also, the _layout.xls files made me believe Indiv, Other and PAS would have \r\nnicar_amount attributes, but i find only amount ?

", "votes": null, "replies": [] }, { "id": 15663, "author_name": "brandonrobertz", "author_url": "", "post_date": "10/15/2012 23:15:22", "content": "

If you're using the FEC data provided here, there are some irregularities like \\xA0 and extra commas, slashes, and quotes in some of the text fields. I had to clean up the data to get MySQL to pick it up correctly (I don't know if that's what you're using).\r\n There are tools for this in my proposal.

", "votes": null, "replies": [] } ], "raw_markdown_by_id": { "15131": "", "15142": "", "15409": "", "15411": "", "15593": "", "15663": "" }, "source": "meta" }