What's A Google Spider

[Norm]

I noticed on the "Who's Online" field, after members there are guests, in that area I see Google Spider, data mining?

[DAB]

it's the ATF looking for triggers and silencers......

[DJ_Critterus]

it's the ATF looking for triggers and silencers......

You sure it isn't IRS agents looking for more of our revenues?

[Learpilot]

You sure it isn't IRS agents looking for more of our revenues?

this ^^^^^^^^^ :seasix:

[Rob]

Google Spider is basically Google’s crawler. A crawler is a program/algorithm designed by search engines to crawl and track websites and web pages as a way of indexing the internet.

When Google visits your website for tracking/indexing purposes, this process is done by Google’s Spider crawler. Once the spider visits your web page, the results are potentially put onto Google’s index, or, as we know it, a search engine results page (SERP). The better and smoother the crawling process, potentially the higher your website will rank.

Crawling means following a path, and in the Search Engine Optimization (SEO) world, this means following the links that appear on your website. This is one reason why site maps are created; they can contain all of the links in a website being used by Google’s bots to look deeply into it.

Given that thousands of new web pages are developed and published every day with even more web pages being constantly updated and redesigned, the Google Spider goes through the web analyzing pages, code and links it can find basing itself on metrics of.
So How Does Google’s Site Indexing Work?

Depending on the meta tag you use, either index or no-index, Google will crawl and index your pages. If you’ve inserted a no-index tag, this means that that page won’t be indexed.

SEO experts recommend only allowing important parts of your website be indexed in order to achieve accurate rankings in search engines. Tags, categories and other not-so-important pages do not need to be indexed, and it may actually work better for your website’s rankings if they’re not. However, each website and its users are different! Some tag, category and other pages may be important for the site, users, and technical operations.

Factors such as your domain’s name, backlinks, internal links may affect the way Google’s spider crawls and indexes your site. The more backlinks you have from trustworthy sites the more likely search engines will find your site.

By using Google’s Search Console AKA Google Webmaster Tools you can check to see how Google is indexing your site and identify what can be done to improve its performance. The more content you add, change, and improve the more activity Google spider detects.

[DAB]

i posted a thread about 3 Gun Dump Boxes here last week or so.

then i searched on Google for images of similar boxes...and what do you know, my pic came up as the 3rd or 4th one it showed, linked back to here.....guess that shows what the spider has been up to.

:DAB:

[Rodnok1]

i posted a thread about 3 Gun Dump Boxes here last week or so.

then i searched on Google for images of similar boxes...and what do you know, my pic came up as the 3rd or 4th one it showed, linked back to here.....guess that shows what the spider has been up to.

:DAB:

It catches what you name the file or tags used... If don't want it to show up use a generic name for files. Download1....

[Rob]

Now, imagine the fantastic results from a google search for

" mac haik chevrolet "

Those yahoos are going to be lucky if they stay in business after the crap they did

[Steve_R]

Now, imagine the fantastic results from a google search for

" mac haik chevrolet "

Those yahoos are going to be lucky if they stay in business after the crap they did

I don't get the hate against them. If they'd put the C8 up for auction at Mecum and it sold for $90k over MSRP nobody would care. They found a buyer willing to pay that and everybody hates them. What's the difference? :shrug:

[Rob]

I don't get the hate against them. If they'd put the C8 up for auction at Mecum and it sold for $90k over MSRP nobody would care. They found a buyer willing to pay that and everybody hates them. What's the difference? :shrug:

Auction means they might not get 90k over asking price or they might get more. They open themselves to the gamble and at the cost of giving a % of that to the broker for handling the deal

[ZipZap]

Google Spider is basically Google’s crawler. A crawler is a program/algorithm designed by search engines to crawl and track websites and web pages as a way of indexing the internet.

When Google visits your website for tracking/indexing purposes, this process is done by Google’s Spider crawler. Once the spider visits your web page, the results are potentially put onto Google’s index, or, as we know it, a search engine results page (SERP). The better and smoother the crawling process, potentially the higher your website will rank.

Crawling means following a path, and in the Search Engine Optimization (SEO) world, this means following the links that appear on your website. This is one reason why site maps are created; they can contain all of the links in a website being used by Google’s bots to look deeply into it.

Given that thousands of new web pages are developed and published every day with even more web pages being constantly updated and redesigned, the Google Spider goes through the web analyzing pages, code and links it can find basing itself on metrics of.
So How Does Google’s Site Indexing Work?

Depending on the meta tag you use, either index or no-index, Google will crawl and index your pages. If you’ve inserted a no-index tag, this means that that page won’t be indexed.

SEO experts recommend only allowing important parts of your website be indexed in order to achieve accurate rankings in search engines. Tags, categories and other not-so-important pages do not need to be indexed, and it may actually work better for your website’s rankings if they’re not. However, each website and its users are different! Some tag, category and other pages may be important for the site, users, and technical operations.

Factors such as your domain’s name, backlinks, internal links may affect the way Google’s spider crawls and indexes your site. The more backlinks you have from trustworthy sites the more likely search engines will find your site.

By using Google’s Search Console AKA Google Webmaster Tools you can check to see how Google is indexing your site and identify what can be done to improve its performance. The more content you add, change, and improve the more activity Google spider detects.

Did you Google that?:rofl:

[Mike Mercury]

https://i.kym-cdn.com/photos/images/original/001/192/049/7a1.png

[snide]

You sure it isn't IRS agents looking for more of our revenues?

The IRS seems to think that our money is actually their money. :crazy::cuss:

[Steve_R]

Auction means they might not get 90k over asking price or they might get more. They open themselves to the gamble and at the cost of giving a % of that to the broker for handling the deal

True, although a reserve at an auction does guarantee them a minimum price unless they lift the reserve early.

[DJ_Critterus]

The IRS seems to think that our money is actually their money. :crazy::cuss:

"Seems?" They and the democrats think we work for them and should hand over all earnings.

[DAB]

spider?

[DJ_Critterus]

spider?

Harlot's Web?

[m and t's77]

The spider bots remind me of The Matrix's Sentinels,snooping around trying to find something that is none of their business.

https://i.pinimg.com/originals/93/14/df/9314df00aa63401df4feeb4aeaa9da13.gif

[dvarapala]

The spider bots remind me of The Matrix's Sentinels,snooping around trying to find something that is none of their business.


Without spider bots there would be no search engines. :shrug:

Also, web crawlers can only access links that are publicly available on the WWW - if something is "none of their business" then it should be protected behind a secure login. :yesnod:

[Frankie the Fink]

Post #5 nailed it. Great explanation and I've been in cyberspace since the DDN-MilNet days and a degreed Computer Scientist, but as Paul Harvey said here is the "rest of the story". Google (and Bing) coallate the search results and through sophisticated algorithms present searchs to different people, in different locales based on many things, much of which is collected as part of your "digital persona" as you are tracked across the web and through other means.. So your spouse and you can enter the same search critieria and come up with vastly different results, and many will be ads which is partly how Google is "monetized" by supporters.

I'm a big fan of "Duck, Duck, Go" for searches, a robust VPN and the Brave browser (often used in Tor mode) and several ad/tracker blockers like Privacy Badger.

[04 commemorative]

You called ?

[DJ_Critterus]

https://i.gifer.com/embedded/download/4vg1.gif

[snide]

https://i.gifer.com/embedded/download/4vg1.gif

Reasonable. :yesnod: