Page 1 of 1

Why does Search ignore some really useful words?

Posted: April 14th, 2021, 12:11 pm
by Breelander
For an investment site, surely the word 'dividend' is an important search term? Apparently not....

Lemon Fool wrote:Information

The following words in your search query were ignored because they are too common words: dividend.
You must specify at least one word to search for. Each word must consist of at least 3 characters and must not contain more than 9 characters excluding wildcards.
search.php?keywords=dividend

Re: Why does Search ignore some really useful words?

Posted: April 14th, 2021, 12:23 pm
by csearle
Breelander wrote:...
I expect the flippin' search engine is playing a numbers game. If one wanted to search for Marks and Spencer it would avoid all the posts with "and" in them. I imagine it is the same mechanism.

Maybe some of the external search facilities for searching this site might be better in this regard?

Chris

Re: Why does Search ignore some really useful words?

Posted: April 14th, 2021, 12:38 pm
by Breelander
csearle wrote:...it would avoid all the posts with "and" in them....


Actually you CAN search for 'and' - if you add a wildcard. Not exactly an intuitive solution though....

search.php?keywords=and*

Re: Why does Search ignore some really useful words?

Posted: April 14th, 2021, 1:00 pm
by dealtn
Breelander wrote:For an investment site, surely the word 'dividend' is an important search term? Apparently not....

Lemon Fool wrote:Information

The following words in your search query were ignored because they are too common words: dividend.
You must specify at least one word to search for. Each word must consist of at least 3 characters and must not contain more than 9 characters excluding wildcards.
search.php?keywords=dividend


Isn't it the opposite problem? It's not ignoring "dividend" but the search brings up too many results to be useful - as it's too common?

Re: Why does Search ignore some really useful words?

Posted: April 14th, 2021, 2:00 pm
by csearle
Breelander wrote:For an investment site...
Maybe you should search for "growing dividend" ;) C.

Re: Why does Search ignore some really useful words?

Posted: April 14th, 2021, 2:30 pm
by Breelander
dealtn wrote:Isn't it the opposite problem? It's not ignoring "dividend" but the search brings up too many results to be useful - as it's too common?


On its own, maybe. But as a qualifier in a search it should reduce the number of results. I specifically wanted to search for "Barclays dividend" and instead got hundreds of results that just included "Barclays"

Re: Why does Search ignore some really useful words?

Posted: April 14th, 2021, 2:41 pm
by Gengulphus
Breelander wrote:
dealtn wrote:Isn't it the opposite problem? It's not ignoring "dividend" but the search brings up too many results to be useful - as it's too common?

On its own, maybe. But as a qualifier in a search it should reduce the number of results. I specifically wanted to search for "Barclays dividend" and instead got hundreds of results that just included "Barclays"

Well, following up on your own earlier comment, searching for "Barclays dividend*" seems to reduce them very effectively! Indeed, perhaps too effectively... :-(

Gengulphus

Re: Why does Search ignore some really useful words?

Posted: April 16th, 2021, 7:09 pm
by Mike4
dealtn wrote:
Breelander wrote:For an investment site, surely the word 'dividend' is an important search term? Apparently not....

Lemon Fool wrote:Information

The following words in your search query were ignored because they are too common words: dividend.
You must specify at least one word to search for. Each word must consist of at least 3 characters and must not contain more than 9 characters excluding wildcards.
search.php?keywords=dividend


Isn't it the opposite problem? It's not ignoring "dividend" but the search brings up too many results to be useful - as it's too common?


How can "too many results" not be useful? Certainly gonna be more useful than none whatsoever.

Re: Why does Search ignore some really useful words?

Posted: April 16th, 2021, 7:52 pm
by dealtn
Mike4 wrote:
dealtn wrote:
Breelander wrote:For an investment site, surely the word 'dividend' is an important search term? Apparently not....

search.php?keywords=dividend


Isn't it the opposite problem? It's not ignoring "dividend" but the search brings up too many results to be useful - as it's too common?


How can "too many results" not be useful? Certainly gonna be more useful than none whatsoever.


If the programme has a threshold output from an enquiry such that if number of results > x then error (or print "the following words in your search query were ignored because they are too common ... "), for instance.

Or do you think that is a more optimal outcome, and more useful, than "none whatsoever"? It looks the same to me.

Re: Why does Search ignore some really useful words?

Posted: April 16th, 2021, 9:57 pm
by Itsallaguess
Breelander wrote:
dealtn wrote:
Isn't it the opposite problem? It's not ignoring "dividend" but the search brings up too many results to be useful - as it's too common?


On its own, maybe. But as a qualifier in a search it should reduce the number of results.

I specifically wanted to search for "Barclays dividend" and instead got hundreds of results that just included "Barclays"


This is one of those situations where Google search is likely to give highly improved results over the limited internal search facilities here.

Google search can be asked to only look on specific sites, so we're able to force it to look at lemonfool.co.uk, and then we can add words to search for with a '+' between the words, which means that returned Lemon Fool pages will contain both 'Barclays' and 'dividend' if required.

In addition to that, we can then ask Google search to limit returned pages based on timescales, so on the example below, we're using all the above tricks to limit returned pages from the past year, although other options for a number of other default timescales are available (hour / day / week / month), as well as a facility to define a custom date-range too...

Image

For anyone interested in investigating the above Google Search process, here's the above Google Search URL link itself that will show the above example in action -

https://www.google.com/search?q=site:lemonfool.co.uk+barclays%2Bdividend&tbs=qdr:y

Note from the above URL search results, that Google Search is clever enough to return both 'Barclays+dividend' results, as well as 'Barclays+dividends' results too, which is also another useful intelligent-search benefit of using the above Google process for these types of more granular searches...

Cheers,

Itsallaguess

Re: Why does Search ignore some really useful words?

Posted: April 17th, 2021, 4:39 am
by Mike4
Itsallaguess wrote:This is one of those situations where Google search is likely to give highly improved results over the limited internal search facilities here.

Google search can be asked to only look on specific sites, so we're able to force it to look at lemonfool.co.uk, and then we can add words to search for with a '+' between the words, which means that returned Lemon Fool pages will contain both 'Barclays' and 'dividend' if required.

In addition to that, we can then ask Google search to limit returned pages based on timescales, so on the example below, we're using all the above tricks to limit returned pages from the past year, although other options for a number of other default timescales are available (hour / day / week / month), as well as a facility to define a custom date-range too...



In addition, for those of us who like to use duckduckgo's anonymous searching, The Duck seems to do much the same:


Image