Simple Price Scrape enhancement now includes Yahoo

[kiloran]

The original version of this tool created by Itsallaguess retrieved prices from Yahoo into a spreadsheet to be used as a lookup table for other spreadsheets. With the suspension of the Yahoo Finance API in mid-2023, the tool was updated to get prices from https://shareprices.com/
However this was limited to shares, ETFs and bonds on the London Stock Exchange.

We've now developed a technique to efficiently retrieve data from the Yahoo web page https://uk.finance.yahoo.com/quotes/VOD ... SE/view/v1
so a new Yahoo sheet has been added to provide the original functionality, allowing the download of global data for shares, ETFs, market indices and currency exchange rates.
This appears to work very well, and has been tested to download all of the FTSE350 shares in a matter of seconds.

I'll now look at incorporating this functionality in other tools such as HYPTUSS, StepOne FTSE350, StepOne Portfolio, etc

The Simple Price Scrape Excel and LibreOffice versions are available at https://lemonfoolfinancialsoftware.weeb ... crape.html

--kiloran

[TerryWood]

Hi Kiloran

Just tried it. It's incredibly fast!

One point I need some help on please. I tried to insert a column before the ticker symbols so that I actually know what share or fund it is . It wouldn't have it. Similarly I tries to put a column after the ticker symbol but the price update overwrote it.

So can you suggest how I can insert the column as above. I am using the LibreOffice version.

Thanks

Terry

[kiloran]

Hi Kiloran

Just tried it. It's incredibly fast!

One point I need some help on please. I tried to insert a column before the ticker symbols so that I actually know what share or fund it is . It wouldn't have it. Similarly I tries to put a column after the ticker symbol but the price update overwrote it.

So can you suggest how I can insert the column as above. I am using the LibreOffice version.

Thanks

Terry

Incredibly fast..... and hopefully incredibly accurate!

Inserting columns as you request is not possible. It is commited to having the share symbol in Col A, price in Col B and currency in Col C. It is intended as a basic, simple tool and cannot be expected to handle various personalised issue like this.

You can use columns D onwards for anything you wish, though there is always a vague possibility that a future enhancement might write extra data to Col D or Col E so I would recommend that you use Col H onwards, and hide Columns D:G

Perhaps the best solution to your problem is to add a new sheet and then in cell B2 of the new sheet, type =$SharePrices.A2
And in Cell C2 type =$SharePrices.B2
And in Cell D2 type =$SharePrices.C2

Column A of the new sheet is then available for your own use.

Hope this helps

--kiloran

[kiloran]

Hi Kiloran

Just tried it. It's incredibly fast!

One point I need some help on please. I tried to insert a column before the ticker symbols so that I actually know what share or fund it is . It wouldn't have it. Similarly I tries to put a column after the ticker symbol but the price update overwrote it.

So can you suggest how I can insert the column as above. I am using the LibreOffice version.

Thanks

Terry

Incredibly fast..... and hopefully incredibly accurate!

Inserting columns as you request is not possible. It is commited to having the share symbol in Col A, price in Col B and currency in Col C. It is intended as a basic, simple tool and cannot be expected to handle various personalised issue like this.

You can use columns D onwards for anything you wish, though there is always a vague possibility that a future enhancement might write extra data to Col D or Col E so I would recommend that you use Col H onwards, and hide Columns D:G

Perhaps the best solution to your problem is to add a new sheet and then in cell B2 of the new sheet, type =$SharePrices.A2
And in Cell C2 type =$SharePrices.B2
And in Cell D2 type =$SharePrices.C2

Column A of the new sheet is then available for your own use.

Hope this helps

--kiloran

And I hope it is evident that in cell B2 of your new sheet, you can type =$Yahoo.A2, etc to get data from Yahoo.
And instead of typing this, you can type = in cell B2 of your new sheet, then click on cell A2 in the Yahoo sheet

--kiloran

[mike]

Works fine for me Kiloran, thank you for your continued support

[Bena48]

Thanks Kiloran. Has Stepone been updated?

[kiloran]

Thanks Kiloran. Has Stepone been updated?

Not yet but I'm currently working on it

--kiloran

[TerryWood]

Hi Kiloran

Thanks for your help on my problem with inserting a column prior to ticker symbol.

Will use your solution

Terry

[PeteHutch]

Forgot to say thank you.

This update is working well

[TerryWood]

Hi @ Kiloran et Al

I am building a portfolio based on this excellent Simple Price Scrape software. LibreOffice Calc version.

I am using the Yahoo tab and there are a mixed number of shares and Mutual Funds. The speed of update is phenomenal.

I have noticed a problem with the Yahoo Funds price downloads in that they seem to vary between 2 and 3 days behind the end of week market close. ie. I update on Saturday mornings (I am UK based) and am able to compare an identical portfolio based on Hyptuss where the fund prices are downloaded from FT.com

It is clear that, for example, that this weekend prices for FT.com funds are based on Friday nights close, whereas Yahoo is based on Wednesday or Thursday prices of this week. My funds are not obscure ones. They are available on many platforms. On the other hand Yahoo share prices math those of FT.com

Has anyone else noticed this behaviour and is it normal , has Yahoo changed its reporting schedule?

Thank you for your help.

Terry

[kiloran]

I have noticed a problem with the Yahoo Funds price downloads in that they seem to vary between 2 and 3 days behind the end of week market close. ie. I update on Saturday mornings (I am UK based) and am able to compare an identical portfolio based on Hyptuss where the fund prices are downloaded from FT.com

It is clear that, for example, that this weekend prices for FT.com funds are based on Friday nights close, whereas Yahoo is based on Wednesday or Thursday prices of this week. My funds are not obscure ones. They are available on many platforms. On the other hand Yahoo share prices math those of FT.com

Terry

I don't have any funds so have no experience of this.

I suspect there is nothing we can do, but it would be helpful if you would give some examples (fund symbols)

--kiloran

[TerryWood]

Hi @ Kiloran

Thanks for your reply. As requested Funds with prices that are not Fridays close.

abrdn Asia Pacific Equity Fund I Acc Fund GB00B0XWNG99:GBP 316.8600
abrdn Emerging Markets Equity Fund I Acc Fund GB0033227561:GBP 785.1000
Abrdn UK Smaller Companies Growth Trust plc Investment Trust AUSC:LSE 439.0000
Artemis SmartGARP European Equity Fund Class I Acc Fund GB00B2PLJD73:GBP 495.0500
AXA Framlington UK Select Opportunities ZI Acc Fund 0P0000XMRR.L 171.0000
Invesco Perpetual Asian Y Acc Fund 0P00012AOT.L 489.7700
Invesco China Equity Fund Y Acc Fund 0P00012ARQ.L 294.9100
Invesco European Equity Y Acc Fund 0P00012AP9.L 391.8400
Invesco Global Equity Fund Y Acc Fund 0P00012APK.L 487.8900
Invesco Global Smaller Companies Fund Y Acc Fund 0P00012APR.L 452.8000
Invesco Rspnb Jpn Equ Val Discovery Fund (UK) Y Acc Fund 0P00012ARV.L 334.6300
Invesco UK Eq High Inc UK Y Acc Fund 0P00012APU.L 234.0300
Invesco UK Equity Inc UK Y Acc Fund 0P00012ART.L 231.2700
Jupiter European Special Sits I Acc Fund 0P0000U20H.L 516.4800
Jupiter Income Trust I Inc Fund 0P0000U20O.L 543.7600
Jupiter UK Smaller Companies Eq I Acc Fund 0P0000X1GJ.L 352.8100
L&G European Index I Inc Fund 0P000023NV.L 358.2000
Maven Income and Growth VCT 5 VCT5 MIG5.L 31.6000
Schroder Asian Income Z Acc Fund 0P0000T362.L 127.2000
Schroder Tokyo Z Acc Fund 0P0000T36D.L 137.6000
Scottish Widows European Gr A Fund 0P00000I62.L 846.5000
USD/GBP Index GBPUSD=X 1.2701

[kiloran]

Hi @ Kiloran

Thanks for your reply. As requested Funds with prices that are not Fridays close.

abrdn Asia Pacific Equity Fund I Acc Fund GB00B0XWNG99:GBP 316.8600
abrdn Emerging Markets Equity Fund I Acc Fund GB0033227561:GBP 785.1000
Abrdn UK Smaller Companies Growth Trust plc Investment Trust AUSC:LSE 439.0000
....snip....

Yes, definately a Yahoo issue.

Looking at the first of your examples, the Yahoo historical data shows

All of the prior history is there, just the last two days is missing, which I guess will be added in the next day or two.

And I noticed a similat but slightly different issue for an ETF, which has the data for friday's close but not thursday. I imagine this might be populated in the coming days, since all other history is there


I don't know what to suggest for the moment, but I'll keep an eye on it. I wonder if the same problem might affect some shares?

--kiloran

[TerryWood]

Hi Kiloran

Thank you for your involvement it is appreciated. I hadn't looked at historical prices.

My concern is the reliability of pricing. Factually, apart from an odd blip, FT.com weekend closing prices are based on Friday close whereas Yahoo funds varies between the previous Wednesday and Thursday. I cannot say when this difference started to occur but in 2023 it was possible to to run a Hyptuss based portfolio and a Simple Price Scrape portfolio and achieve the same prices/Net Worth, now it is not. (possible)

Why this matters is that I am using these portfolios as an aid to my family. On death in the UK a system called Probate kicks in in which Taxpayers have to submit their tax affairs including securities for evaluation. Clearly an accurate listing of security pricing is essential.

In any event, since your two excellent updaters are used by people populating this forum a requirement for up to date prices is essential so I like you, will keep an eye on Yahoo.

Finally is it possible that after many attempts at stymying people from using API to scrape prices from their website Yahoo are attempting the same by a different method?

Again thanks for your help and keep up the good work.

Terry

[kiloran]

Finally is it possible that after many attempts at stymying people from using API to scrape prices from their website Yahoo are attempting the same by a different method?

Terry

No, I don't think Yahoo are trying to stop people scraping data from their web pages, the data is the same whether it is viewed manually via a web browser or scraped by a program.

The data hasn't changed this morning. I believe Unit Trust / OEIC prices are set once per day, so maybe it will sort itself out tonight. The data for the ETF VWRL.L is more screwed up today. Yesterday, it had data for 26Jan24 but missed data for 25Jan24. Today, it has data for 29Jan24 (today) but has no historical data for 25Jan24 or 26Jan24.

Over many years, we have found that Yahoo is generally OK but does have a few problems now and again. It's good but not 100% reliable. I think most data sources have problems from time to time, but Yahoo perhaps has more problems than most.

--kiloran

[AJC5001]

The data hasn't changed this morning. I believe Unit Trust / OEIC prices are set once per day, so maybe it will sort itself out tonight. The data for the ETF VWRL.L is more screwed up today. Yesterday, it had data for 26Jan24 but missed data for 25Jan24. Today, it has data for 29Jan24 (today) but has no historical data for 25Jan24 or 26Jan24.

--kiloran

I've just looked at VWRL and VWRP on Yahoo https://uk.finance.yahoo.com/quote/VWRL.L/history?p=VWRL and https://uk.finance.yahoo.com/quote/VWRP.L/history?p=VWRP.L and can't see anything missing. Does this mean it's been fixed?

Adrian

[kiloran]

The data hasn't changed this morning. I believe Unit Trust / OEIC prices are set once per day, so maybe it will sort itself out tonight. The data for the ETF VWRL.L is more screwed up today. Yesterday, it had data for 26Jan24 but missed data for 25Jan24. Today, it has data for 29Jan24 (today) but has no historical data for 25Jan24 or 26Jan24.

--kiloran

I've just looked at VWRL and VWRP on Yahoo https://uk.finance.yahoo.com/quote/VWRL.L/history?p=VWRL and https://uk.finance.yahoo.com/quote/VWRP.L/history?p=VWRP.L and can't see anything missing. Does this mean it's been fixed?

Adrian

Yes, it's fixed for VWRL.L. I last checked early afternoon and it had missing history, but it's OK now. Still have a problem with the abrdn fund.

--kiloran

[TerryWood]

Hi Kiloran

I checked the Yahoo Fund prices this morning @ 0750 hours UK time Tuesday 30 January 2024. The prices have now changed to Mondays close 29 January 2024. So you were right.

The next test will be, do we get daily prices this week and a Friday close.

Terry

[TerryWood]

Hi Kiloran et al

I checked the Fund prices on Yahoo this morning (Saturday 3 February 2024). The last price displayed is 1 February 2024 (Thursday). So we have had four working days of updates but Fridays close is missing. Better than when I first posted but not particularly helpful.

Conclusion Yahoo is unreliable, stick with FT.com (Hyptuss)

Terry

[kiloran]

Hi Kiloran et al

I checked the Fund prices on Yahoo this morning (Saturday 3 February 2024). The last price displayed is 1 February 2024 (Thursday). So we have had four working days of updates but Fridays close is missing. Better than when I first posted but not particularly helpful.

Conclusion Yahoo is unreliable, stick with FT.com (Hyptuss)

Terry

It looks like ft.com updates fund prices in the early evening, 6-7pm.

Yahoo seems to update much later, sometime before the next day market opening, so friday's price isn't updated until the following monday morning. And it's even more screwed up today. The data from https://finance.yahoo.com/quote/0P00007 ... 00007VND.L shows thursday's close in the top left corner, but the history shows friday's data but rounded and out by a factor of 100! Thank goodness they don't have similat problems with normal shares and ETFs.


--kiloran