Search Industry Blog - When Will We Start Finding? 



A Post on the Search Industry Blog

FyberSearch Newsletter #26
By Nathan Enns on Tuesday, November 2nd, 2004 at 12:00 AM
FyberSearch Newsletter #26 (10-15-04 through 11-01-04)


There is quite a bit going on at FyberSearch right now. Database redesign, more features and the acquisition of the feed search engine feedplex.com. More details:

1. The FyberSearch News Blog is now available in RSS format at http://www.fybersearch.com/blog/rss.xml

2. FeedPlex is a search engine for XML, RSS, ATOM and RDF file formats. Like other feed search engines FeedPlex allows users to search for news, blogs and articles instead of searching for web pages in general. http://www.feedplex.com does not currently allow users to search. The search functions will be enabled when FyberSearch has completed making a few updates. The former owner and founder of feedplex.com was Sid Yadav who currently owns the Daily Rundown at http://www.dailyrundown.com

3. I am also in the process of changing the database design. After it is complete I will release a few more features that I have found useful to use myself. Until it is done the website and search may be slower than normal. I apologize for the inconvenience.

4. FyberSearch is now better able to parse RSS files. Just go to the add URL forms at http://www.fybersearch.com/add-url.php and test it out. Make sure to alert me of any bugs. Also, it will only work if the file you submit ends with .xml .rss or .rdf. You should be able to view the URL as a web crawler and see the XML data processed.


I plan to start answering questions people ask me every so often in this newsletter. This question was asked by Tom Kay. His email address is tom.kay@thanetcomputers.co.uk and his website address is http://www.a1credit.co.uk

****** The Question ******

I use your website quite regularly to check out the performance of my pages from a web crawler’s point of view, but I just wondered if you could let me know how the URL value works.

****** The Answer ******

I am glad to hear that you have found the view like FyberSpider feature useful. Unfortunately I cannot tell you exactly how the FyberSearch URL Value works or else it would be easy for everyone to get a 10.

I can tell you that it takes into consideration the following information.
1. The title of each web page.
2. The content of each web page.
3. The web page address.
4. The domain name.
5. The header, bold, and lists you have in the content.

The impertinence is not necessarily in that order. I would like to tell you more but it would risk the ranking system if I shared more info.

I can also provide a few tips for achieving a higher value and avoid being excluded from the FyberSearch database.

1. Include words in the title tag of each web page that describe that page.

2. Try to put content on each page that relates to the topic(s) of that specific page.

2. Do not use redirecting pages. The web crawler FyberSpider looks at that page and receives an error. Many other web crawlers catalog the data found at the end URL after the redirect is complete. FyberSpider ignores redirecting pages.

3. Do not put the words "302" and "found", "moved" and "permanently", or "not" and “found” in the title of any web page. FyberSpider may decide to ignore the page otherwise.

4. FyberSpider does not catalog any URL that any one of the following characters: ?, &, %, #, or @.

****** The End ******

If you have a question please send an email to owner@fybersearch.com

Make sure to specify what contact information you would like to be included in the newsletter. I cannot promise that all questions are included but I will do my best to answer you question by replying to your email at the very least.