Author Topic: changes in information available for notes that have been issued  (Read 5673 times)

faeriering

  • Full Member
  • ***
  • Posts: 135
    • View Profile
changes in information available for notes that have been issued
« on: November 25, 2012, 06:09:54 PM »
So I've been wanting to do further analysis on my notes.cvs file to analyze for abnormal losses in specific notes.  But when I downloaded the file, there was only about 10 columns of information.  A far cry from the hundreds (it seems like) rows in the browse notes cvs file.  So I thought I'd pull the statistics file down with all the information on all the notes FROM THE BEGINING OF TIME . . . only to find that file had also been neutered of several of the columns.  When I look at my portfolio at Lend stats, I can see the data is somewhere though because it is showing up.

Does anyone know where the "intact" data is stored with all the relevant columns that sites like Lendstats and Nicklesteam Roller are using to do their statistical anaylsis?  I would like the file to start to do some of my own analysis.  I love Lendstats site, but it doesn't give information based on employer, and I'm really interested in seeing if I've gotten higher losses with the loans that have "n/a" for employer than the others.

Thanks for any help you all can provide :)

brycemason

  • Hero Member
  • *****
  • Posts: 801
    • View Profile
    • P2P-Picks.com
    • Email
Re: changes in information available for notes that have been issued
« Reply #1 on: November 25, 2012, 11:23:50 PM »
Employer is not in any file LC provides. I think some of these websites have been writing screen scrapers to get some extra fields.

faeriering

  • Full Member
  • ***
  • Posts: 135
    • View Profile
Re: changes in information available for notes that have been issued
« Reply #2 on: November 26, 2012, 07:10:34 PM »
Employer is in the browse Notes file that is available from LC, but that's only for notes that haven't been fully funded yet.

viking

  • Sr. Member
  • ****
  • Posts: 370
    • View Profile
    • Email
Re: changes in information available for notes that have been issued
« Reply #3 on: November 26, 2012, 09:31:47 PM »
Employer is in the browse Notes file that is available from LC, but that's only for notes that haven't been fully funded yet.
There are two types of "browse Notes" files; the first can be downloaded only after you log in to your account and the the second can be downloaded here: https://www.lendingclub.com/fileDownload.action?file=InFunding2Stats.csv&type=gen

The first one contains the employer (if available) and this file is updated very frequently (a few minutes or less). The second one does not contain the employer and is update infrequently (somewhere between one and a few times per day).

Unfortunately, I believe that per Lending Club's terms of use, it is not allowed to automate the login process to download the file which contains the employers. That is why Lendstats etc do not have this category. I would like to have investigated this as well!

p.s. As a somewhat poor substitute, you could always try Employment length=NA (this would not capture self-employed who may have NA as employer but list many years of employment). Here are the NSR results for :
Employment length=NA : ROI=4.82%
Employment length=All but NA: ROI=7.32%
Employment length= 5 yrs or more: ROI=7.64%

faeriering

  • Full Member
  • ***
  • Posts: 135
    • View Profile
Re: changes in information available for notes that have been issued
« Reply #4 on: November 27, 2012, 07:59:23 AM »
@Viking,

Thanks so much for that link!  Is there a place that has that data for historical loans as well?  The file that used to be available under the Statistics tab had way more info than the current one.

Thanks again!!

Megan


brycemason

  • Hero Member
  • *****
  • Posts: 801
    • View Profile
    • P2P-Picks.com
    • Email
Re: changes in information available for notes that have been issued
« Reply #5 on: November 27, 2012, 10:23:59 AM »
The historical file doesn't seem to have employer. It does have employment length, but NA was only an option since January 2010.

viking

  • Sr. Member
  • ****
  • Posts: 370
    • View Profile
    • Email
Re: changes in information available for notes that have been issued
« Reply #6 on: November 27, 2012, 02:41:09 PM »
@Viking,

Thanks so much for that link!  Is there a place that has that data for historical loans as well?  The file that used to be available under the Statistics tab had way more info than the current one.

Thanks again!!

Megan

Here is the current page with 3 links for data downloads:
https://www.lendingclub.com/info/download-data.action

Top: Historical data (Is that the link that you were referring to as having less information now?)
Middle: The currently available notes (In funding). This is the same link as the link that I showed above. Note that you get more info (e.g. including employer if you log in and download here:  https://www.lendingclub.com/browse/browseNotesRawDataV3.action)
Bottom: Declined Loan Data

faeriering

  • Full Member
  • ***
  • Posts: 135
    • View Profile
Re: changes in information available for notes that have been issued
« Reply #7 on: November 28, 2012, 08:25:53 PM »
@ Viking,

Thanks again for the links.  The top file is the historical file that I was referring to as having less data than it used to.

Thanks again for the help!

AnilG

  • Hero Member
  • *****
  • Posts: 1095
    • View Profile
    • PeerCube
Re: changes in information available for notes that have been issued
« Reply #8 on: December 01, 2012, 02:09:52 AM »
The new link for the latest version of browse notes file is https://www.lendingclub.com/browse/browseNotesRawDataV4.action. The link quoted below will give you browse notes file that doesn't have the six new parameters.


Middle: The currently available notes (In funding). This is the same link as the link that I showed above. Note that you get more info (e.g. including employer if you log in and download here:  https://www.lendingclub.com/browse/browseNotesRawDataV3.action)

---
Anil Gupta
PeerCube Thoughts blog https://www.peercube.com/blog
PeerCube https://www.peercube.com

viking

  • Sr. Member
  • ****
  • Posts: 370
    • View Profile
    • Email
Re: changes in information available for notes that have been issued
« Reply #9 on: December 01, 2012, 04:47:54 AM »
The new link for the latest version of browse notes file is https://www.lendingclub.com/browse/browseNotesRawDataV4.action. The link quoted below will give you browse notes file that doesn't have the six new parameters.


Middle: The currently available notes (In funding). This is the same link as the link that I showed above. Note that you get more info (e.g. including employer if you log in and download here:  https://www.lendingclub.com/browse/browseNotesRawDataV3.action)

Yes the previous link to download notes on the "Browse Notes" Page (after logging in; called "Download All") has now been replaced with https://www.lendingclub.com/browse/browseNotesRawDataV4.action

(note that you can still download an even earlier version:
https://www.lendingclub.com/browse/browseNotesRawDataV2.action
However, there is no direct link for that one either)

davemwein@gmail.com

  • Newbie
  • *
  • Posts: 1
    • View Profile
Employer of Borrower
« Reply #10 on: December 11, 2012, 09:38:31 PM »
Earlier this year I wanted to find out if the employer of the borrower effected the default rate. Since May 2012, I have been collected data from the Browse file on employer. After a few trial and errors, I segregated  the employer into various categories. I have 11 groups and several are Medical, Professional, School, and the biggest (48%) is the Common group. These are employers like Joe's pizza. Most of the employers fall into obvious categories, but I'm often on Google to check it out. I have over 3000 search terms that automatically slot the records. I started in May 2012 and since that time only 12 notes have defaulted. That is, notes that were original listed in May 2012 until today. It is certainly too early to draw any conclusions, but it is interesting that 11 of the 12 defaults are in the Common Group. It will probably take another 6 months or so to begin to draw any conclusions

Dave
 


viking

  • Sr. Member
  • ****
  • Posts: 370
    • View Profile
    • Email
Re: Employer of Borrower
« Reply #11 on: December 12, 2012, 12:25:25 AM »
Earlier this year I wanted to find out if the employer of the borrower effected the default rate. Since May 2012, I have been collected data from the Browse file on employer. After a few trial and errors, I segregated  the employer into various categories. I have 11 groups and several are Medical, Professional, School, and the biggest (48%) is the Common group. These are employers like Joe's pizza. Most of the employers fall into obvious categories, but I'm often on Google to check it out. I have over 3000 search terms that automatically slot the records. I started in May 2012 and since that time only 12 notes have defaulted. That is, notes that were original listed in May 2012 until today. It is certainly too early to draw any conclusions, but it is interesting that 11 of the 12 defaults are in the Common Group. It will probably take another 6 months or so to begin to draw any conclusions

Dave
You may want to check out the Employer listed as "N/A" as well. I suspect that it contains a lot of self-employed people (in particular if they have an employment length different from "N/A"). Any "very preliminary" data on this group?