Author Topic: 2014-08-21 10:00 - no LC publication?  (Read 15203 times)

brother7

  • Full Member
  • ***
  • Posts: 130
  • Aloha!
    • View Profile
    • Email
2014-08-21 10:00 - no LC publication?
« on: August 21, 2014, 01:14:40 PM »
It's now 10:13 and the most recent LC publication has a timestamp of 2014-08-21 06:01:03. It there a problem with LC or P2P-Picks feeding?

brycemason

  • Hero Member
  • *****
  • Posts: 801
    • View Profile
    • P2P-Picks.com
    • Email
Re: 2014-08-21 10:00 - no LC publication?
« Reply #1 on: August 21, 2014, 01:22:02 PM »
Logging into LendingClub.com [trigger]...
[Thu Aug 21 10:00:28 PDT 2014]: Loans on platform...
[Thu Aug 21 10:00:28 PDT 2014]: 684
[Thu Aug 21 10:01:01 PDT 2014]: 606
[Thu Aug 21 10:02:00 PDT 2014]: 598
[Thu Aug 21 10:02:49 PDT 2014]: No rise detected. Aborting main script.

I probably missed the rise because of starting looking at 28 seconds after the hour. By then perhaps it was already loaded. I've changed the script to start at 1 second after the hour. However, you can see that people are buying up paper quite quickly between 28s after the hour and 1 minute after the hour (the first moment loans are seeable in the CSV file). See my "asymmetrical timing" thread for more details.


Fred

  • Hero Member
  • *****
  • Posts: 1421
    • View Profile
Re: 2014-08-21 10:00 - no LC publication?
« Reply #2 on: August 21, 2014, 04:51:56 PM »
I probably missed the rise because of starting looking at 28 seconds after the hour. ...

You missed it, Bryce. ;-)

Quote
2014-08-21 09:59:54,613 [LoanDataThread] INFO  https://resources.lendingclub.com/secure/primaryMarketNotes/browseNotes_1-RETAIL.csv in 0.22 seconds.
2014-08-21 09:59:54,921 [LoanDataThread] INFO  GetLoanDataThread - Iteration 1. Got 503 loans, delta=0% in 0.52 seconds.
...
2014-08-21 10:00:05,895 [LoanDataThread] INFO  https://resources.lendingclub.com/secure/primaryMarketNotes/browseNotes_1-RETAIL.csv in 0.03 seconds.
2014-08-21 10:00:06,250 [LoanDataThread] INFO  GetLoanDataThread - Iteration n. Got 589 loans, delta=17.1% in 0.38 seconds.

brycemason

  • Hero Member
  • *****
  • Posts: 801
    • View Profile
    • P2P-Picks.com
    • Email
Re: 2014-08-21 10:00 - no LC publication?
« Reply #3 on: August 21, 2014, 05:06:03 PM »
Hmm. So the CSV is populating on the hour now?

brycemason

  • Hero Member
  • *****
  • Posts: 801
    • View Profile
    • P2P-Picks.com
    • Email
Re: 2014-08-21 10:00 - no LC publication?
« Reply #4 on: August 21, 2014, 05:07:34 PM »
I've started my script at 1 minute before the hour now. Hopefully this is rectified. Stuff like this happens.

brycemason

  • Hero Member
  • *****
  • Posts: 801
    • View Profile
    • P2P-Picks.com
    • Email
Re: 2014-08-21 10:00 - no LC publication?
« Reply #5 on: August 21, 2014, 09:06:16 PM »
I just didn't see much this run, but it appears to have caught the load as much as possible.

[Thu Aug 21 17:59:03 PDT 2014]: Loans on platform...
[Thu Aug 21 17:59:04 PDT 2014]: 542
[Thu Aug 21 18:01:01 PDT 2014]: 646
[Thu Aug 21 18:01:01 PDT 2014]: Initiating main script.
[Thu Aug 21 18:01:01 PDT 2014]: Making picks ...
[Thu Aug 21 18:01:02 PDT 2014]: Placing notes into shopping carts ...
[Thu Aug 21 18:01:02 PDT 2014]: Available Cash [brycemason]: 666
[Thu Aug 21 18:01:02 PDT 2014]: Copying picks to server ...
[Thu Aug 21 18:01:03 PDT 2014]: Importing picks to database ...
[Thu Aug 21 18:01:03 PDT 2014]: Piping picks to Bluevestment ...
[Thu Aug 21 18:01:25 PDT 2014]: Backing up and time-stamping original browseNotes file ...
[Thu Aug 21 18:01:25 PDT 2014]: Cleaning up files ...

Fred

  • Hero Member
  • *****
  • Posts: 1421
    • View Profile
Re: 2014-08-21 10:00 - no LC publication?
« Reply #6 on: August 21, 2014, 10:29:29 PM »
All I see is the number of the beast.  8)
« Last Edit: August 22, 2014, 11:08:12 AM by Fred »

hoggy1

  • Sr. Member
  • ****
  • Posts: 401
    • View Profile
    • Email
Re: 2014-08-21 10:00 - no LC publication?
« Reply #7 on: August 22, 2014, 06:40:06 AM »
New LoansSold% Sold
[Thu Aug 21 09:59:54 PDT 2014]: 503503
[Thu Aug 21 10:00:28 PDT 2014]: 684684181
[Thu Aug 21 10:01:01 PDT 2014]: 6066067878043.1
[Thu Aug 21 10:02:00 PDT 2014]: 598598886047.5

I knew I had to hurry at feeding time but this is a bit over the top. 181 new loans was not a bad load. 43% of all new loans are gone in 30secs and almost half in 2minutes. WOW!
Steve

rawraw

  • Hero Member
  • *****
  • Posts: 2761
    • View Profile
Re: 2014-08-21 10:00 - no LC publication?
« Reply #8 on: August 22, 2014, 09:05:51 AM »
All is see the number of the beast.  8)
ha ha

brycemason

  • Hero Member
  • *****
  • Posts: 801
    • View Profile
    • P2P-Picks.com
    • Email
Re: 2014-08-21 10:00 - no LC publication?
« Reply #9 on: August 22, 2014, 09:13:53 AM »
It seems the API has the speed advantage now. I'll have to adjust my processes to use it this weekend. Sorry for the hiccups!

johnh530

  • Newbie
  • *
  • Posts: 10
    • View Profile
Re: 2014-08-21 10:00 - no LC publication?
« Reply #10 on: August 22, 2014, 01:42:08 PM »
Appreciate what you can do to get more loans.

At 6:00AM I saw 65 loss minimizer and 5 profit maximizer
At 10:00AM I'm not seeing any.

Hope this does not wreck you weekend ;-)

johnh...

brycemason

  • Hero Member
  • *****
  • Posts: 801
    • View Profile
    • P2P-Picks.com
    • Email
Re: 2014-08-21 10:00 - no LC publication?
« Reply #11 on: August 22, 2014, 03:41:53 PM »
I shut it down until I could fix it. Let's see what happens at 2 p.m.

johnh530

  • Newbie
  • *
  • Posts: 10
    • View Profile
Re: 2014-08-21 10:00 - no LC publication?
« Reply #12 on: August 22, 2014, 07:11:47 PM »
Got 24 new loans at 2:00PM - including 6 5% max profit - was able to convert 4 of them.
Looks like the capture time was 2:00:32 rather than the typical x:01:01 time.
Kudos for the adjustment!

johnh...

brycemason

  • Hero Member
  • *****
  • Posts: 801
    • View Profile
    • P2P-Picks.com
    • Email
Re: 2014-08-21 10:00 - no LC publication?
« Reply #13 on: August 23, 2014, 09:24:34 AM »
Yes, it's pulling from the LC API now. I still think it may not be the fastest way (I also did not convert on those same two loans, which is saying something). Of course, there is some expected level of non-convert which is random, because LC does not want us hitting their API more than 1/s.

Thanks for the kudos, because it was quite a bit of work.

brother7

  • Full Member
  • ***
  • Posts: 130
  • Aloha!
    • View Profile
    • Email
Re: 2014-08-21 10:00 - no LC publication?
« Reply #14 on: August 28, 2014, 10:45:15 PM »
Were there really no loans for both LC PMax and LC LMin at Thursday's 6pm feeding? (8/28/2014)