On April 24th, 2012 Matt Cutts, the head of Webspam at Google, announced they would be releasing the first “Penguin Algorithm”.
Although the focus these days is mostly about links many people forget Penguin was not released to only target link spam, it was also created to target “…sites that we believe are violating Google’s existing quality guidelines.” So, before it was named the Penguin update, it was referred to as the “over-optimization” algorithim.*
(It is also important to note, no one from Google has stated that it is not still targeting over-optimization or quality signals.)
“To that end we’ve launched Panda changes that successfully returned higher-quality sites in search results. And earlier this year we launched a page layout algorithm that reduces rankings for sites that don’t make much content available “above the fold.”
In the next few days, we’re launching an important algorithm change targeted at Webspam. The change will decrease rankings for sites that we believe are violating Google’s existing quality guidelines.”.
(http://googlewebmastercentral.blogspot.com/2012/04/another-step-to-reward-high-quality.html)
Penguin Devastation.
The first Penguin release had fairly devastating results for many sites. Over 3.1% of all queries were affected which, though it doesn’t sound like a lot, if you figure how many queries Google sees a day is actually quite significant. Unlike other updates in the past, the sites that attempted to fix their issues did not seem to recover. True or not, it became a generally held belief that sites hit by Penguin 1.0 would never recover. In fact, to this day many site have not and the recovery rate from Penguin 1.0 was estimated to be as low as 1%.
Penguin Spreads.
While Penguin 1.0 was devastating to many sites, the first targets were only the homepages of the site affected. After Penguin 2.0 was released, all pages of a site could experience serious devaluations.
Here is a summary chart of the dates of Penguin updates and queries affected.
Penguin Releases (and the Impact)
- Penguin 1.0 > April 24, 2012 (3.1% of queries)
- Penguin 1.2 > May 26, 2012 (0.1%)
- Penguin 1.3 > Oct. 5, 2012 (0.3% of queries)
- Penguin 2.0 > May 22, 2013 (impacted 2.3% of queries)
- Penguin 2.1 > Oct. 4, 2013 (1% of queries)
Disavow Files.
With the release of Penguin came the first disavow files, these files were filled with links that sites were reporting as “spammy” or bad. Though not confirmed, common theory was that Google had run out of ways to detect link networks and the like, so it needed data users could provide. It makes sense. If enough people reported the same sites, same IP addresses or C classes, Google could more easily detect link networks that were more invisible to them or out of reach of their toolset.
Google’s announcement of the demise of another paid link source became commonplace.
Spam.
The focus of this update, as most updates from Google, was of course Webspam. Few people, even people who utilized the blackhat methods Google was targeting, could really fault Google for implementing an algorithm that would help with the takedowns of link networks.
However, unlike the days before Penguin, when a link takedown just meant you lost link value to your site, Penguin actually would remove most or all of an offending sites traffic by sending it plunging down the rankings. Number 1 yesterday, nowhere to be found today. That is how fast it happened.
For many this is also where the conflict begins. Were the Penguin updates too harsh?
Didn’t They Deserve It?
When someone criticizes the Penguin update as being too harsh that thought is often met with the claim that sites that did “bad things” deserved the “bad things” that happened to them. A reap what you sow kind of thinking. While that may or may not be true depending on how you view the relationship between SEO and Google, many of the sites affected had no idea that they were doing “bad things” because the person they hired to do the work did the “bad things” without properly informing the client. So while some did know what they were doing and took that risk willingly, it is not as simple as they deserved it, many didn’t.
Enter Negative SEO.
In addition to the loss of position by website owners that purchased blackhat services either knowingly or unknowingly, came the issue of Negative SEO.
How Does Negative SEO Work?
Negative SEO is a technique used to take down competitor sites by directing bad links at that site. When running Penguin Updates, Google uses a percentage threshold of good to bad links to evaluate a site’s link profile. If a site has X% bad links it loses position when the Penguin algorithm comes through, if it had Y% good links it might even gain position. Since this % threshold could be used to effectively damage other sites, those in competitive markets owners suddenly saw their sites inundated with bad links from porn, pharma or other spam link networks.
Those Links Don’t Hurt.
At first, Google denied these “negative” links could hurt your site. However, in the wild testing and a multitude of case studies have shown this is simply not the case. While Google would sometimes ignore the inbound Negative SEO spam links, they often would not and that site would receive a devaluation during the next Penguin update.
Recovery.
So Google released an imperfectly applied punishment for sites that may have or may not have known their link profiles were “bad”. Given the issues in application as well as the resulting loss of rankings, SEOs and site owners started having issues with this process. A business losing almost all site traffic overnight can have a very negative effect on a bottom line and people’s lives.
Of course Google often threw this issue off to a no worries policy, you just have to wait for the Penguin update to come through and you will get your rankings back right? Well first no. Many sites lose so many links during the recovery process that the link profile needs to be rebuilt. However, there is a much larger issue than link loss at play.
Time Between Updates.
Penguin updates are the ONLY way to recover from a bad Penguin update. Then if you have done enough work, Penguin might reward you with an uplift in traffic and the chance to recover your site. Of course, you might also find the algorithm did not find your work sufficient and now you had to wait for a second wave. Except when would it arrive?
No Updates In Sight.
The first Google Penguin release was April 24th 2012. The next major update was March 13th 2013. The update following that was Oct 6th, 2013 with a few quick ones following each other in Oct 2014 and then everflux in Nov 2014-Dec 2014.
We can see a pattern here. The first major update was nearly one year from the first. The next time period between major updates was six months. The next was twelve to thirteen months. Now, it is almost June 2015 and we have been waiting again six months for a new update. During this time sites affected by Penguin CANNOT recover their sites.
Six months? Thirteen months? Just how many months does it take to put a company out of business?
“But aren’t there real-time updates now?”
No Real-Time Penguin.
Recently there was some confusion about whether the Penguin updates had become real-time or not. This confusion comes from a Google Webmaster Hangout with John Mueller where he stated that the algorithms were, in fact, running in real-time. This is not actually what was meant, however. Mariya Moeva of Google Russia clarifies this for us in a Google Hangout where she explains John’s statement.
“Without the updated data, even though these algorithms are built into the real time infrastructure, you won’t see any changes to your rankings around those specific algorithms. “
https://www.seroundtable.com/google-panda-penguin-real-time-data-manual-20283.html
So we do have real time crawling, but updates (meaning potential recovery) can only happen when the algorithm is manually implemented.
Can’t you just start a new site?
Perhaps, but it is not that simple. Google now redirects inbound site links when it can tell the sites are the same sites by the same owner (It’s a courtesy) even when not redirected. Since the first site was penalized for links, you can get a new site up and running and find the next time the Penguin update occurs, your site is in the same position as the old one.
Given the devastation of a Penguin “penalty”, the way it is applied, how it can be used against you and the very long periods of time between updates it might be time to ask – is this right? And to take it one step further, is it ethical?
The Ethics of Penguin.
Penguin is one of the most devastating algorithms to come out of Google. As mentioned, once affected, sites have to wait many months maybe a year to try to have an opportunity to recover their visibility and traffic. During this time companies are often forced to lay off staff or even close their businesses.
This seems like a hefty price to pay because you made a mistake, either knowingly or not, or someone attacked your website.
Now we have a point where the very real question of ethics comes into focus.
Evil Google?
The sheer time between updates, the fact that it happens to sites whose owners have been targeted or simply did not know, combined with how much traffic a site loses makes it a very lethal update.
What makes it worse is there is really no reason for it. Before Penguin existed you would simply lose your link values if you had a “spammy” link profile and for sites Google found particularity egregious, a manual penalty would work nicely.
This practice had the same effect on the site as the Penguin “penalty” with one very large difference. With a loss of links you can recover by simply building good links and with a manual penalty you have someone to which you can appeal. The goal was to remove website spam, but instead many legitimate businesses are losing their livelihoods.
Terminator Algorithms.
It is easy to understand why Google started the Penguin updates and if it could be run every 30 days like clockwork most would likely have no issue with its presence. Even if a site could recover from the devaluation that quickly, they would still need to rebuild their link profile and that would take more than a few months. This would be a hard slap to the site owner and Google would still get its disavow data.
However, this is not how it works. The collateral damage is high and often complete.
The Cost.
Of course Google should be able to update its algorithms to manage their search. Not likely, many would argue that point. They should be able to punish those who violate the guidelines; after all it is their search engine. Heck the thought of an impending site dying on the SEO vine because of a Google update is just the part of the game those who utilize black hat tactics love. Did they get away with it? Did Google figure it out? Knowing Google didn’t definitely creates a bit of a rush. However, should they be allowed to destroy businesses?
Penguin is the terminator of algorithms. Though Google has encouraged people for years to participate in the Internet economy it keep releasing a set of sites killing algorithms. Site killing algorithms from which, many companies cannot recover.
My Mom.
Like many people my mom lived on the money she made from her business. It supplemented her meager bit of social security and disability. She was not able to work regular jobs due to severe lung disease, but she managed to make quite a tidy sum selling belt buckles online. She was proud of this business. She deserved to be so. Yet, what if she had made a mistake? What if she woke up one morning to no traffic because someone targeted her business? Or a bad provider bought links? What would have happened to her? She would not have survived financially. Thankfully we never had to find out, but she was lucky. So many others are not.
For a business owner, a Penguin update is no different than someone burning your business to the ground with no known time frame in which you can rebuild. Does Google need to remember that behind these websites they send to “Penguin Hell” are people like my mom who relied on their businesses to put food on their table, to pay their rent, to pay employees, to live? In its quest for dominance, has Google forgotten there are human faces with families and lives behind these websites that get caught up in the collateral damage of their algorithmic practices?
I think they have forgotten. Maybe they need a reminder.
(Note I don’t do links)
Latest posts by Kristine Schachinger (see all)
- What Webmasters Should Know About Stagefright - August 20, 2015
- The Penguin Algorithm: An Issue of Ethics - June 2, 2015
- Analyzing the UK Apprentice Winner’s Climb Online Website: Killer SEO or SEO Fail? - March 11, 2015
- Is Lord Sugar Legitimizing Everything Wrong in the SEO Industry? - January 13, 2015
Andrew says
Wow, there should be more discussion around Penguin just like this one. This is the real heart of the issue right here.
Yep, it is just like burning a business to the ground, without any investigation to find out the facts surrounding it. Google is simply too powerful. I wonder if Matt Cutts realized this and his conscience simply would not let him participate in it any longer, so he went on an indefinite leave.
Thanks for writing this. You’re absolutely right. It is unethical how Google is behaving.
Michal says
I was forced to sell my business because of Penguin. 1.0 which penalised my site for 6-8-year old links.
But what can you do? Need to adapt and work hard to make it work without free search traffic.
Yair Spolter says
Thanks for this comprehensive post, Kristine.
It so beautifully articulates the frustration that so many of us suffering from negative SEO are feeling.
Let’s hope that the big G wakes up and fixes this colossal flaw.
Chris says
Well said – a very eloquent summary of events.
Norton Loomer says
I agree that it would be wonderful if Penguin updated in real-time (or at least every 30 days or so). But I also disagree with the notion that Google is destroying businesses with the Penguin algorithm.
In the vast majority of Penguin cases, the business is “penalized” because of something it did wrong (whether directly through their own team or indirectly through an SEO team it hired). The number of negative SEO cases resulting in Penguin “hell” is likely almost non-existent compared to the “deserved” Penguin adjustments. Very few people in the industry have been able to cite real examples of websites affected long-term by negative SEO. And those who have rely mostly on speculation and loose logic.
Saying that Penguin is like someone burning your building to the ground is a hugely false analogy for a variety of reasons. When someone else burns your building to the ground, you are completely innocent victim. When you get a Penguin penalty, there’s a very good chance that you aren’t innocent. On the flipside, when someone burns your building to the ground, you often get the support of the community in addition to insurance money. If your site gets a Penguin penalty, then you get none of this (hmm…should someone start a Penguin Insurance company?). Finally, if your building is burned to the ground, then you cannot do business from that building until it is rebuilt.; If your site receives a Penguin penalty, you can still do business on your website.
Additionally, if Penguin ruins your business, then you had a horrible business model to begin with. Any business strategy worth anything will invest in a variety of channels. If you only rely on organic search, then your business is going to fail anyway.
Kristine Schachinger says
Norton thanks for your comments.
First, as mentioned in the write-up there are plently of business owners who had no idea they purchased bad services.
It is very easy for us to think that they would have to know, but since most do not understand the difference between link acquisition and link buying, I will have to disagree that most know that they are falling on the wrong side of Google and can lose their websites (or at least all the visibility which is about the same).
I have worked with enough audits to know that this is simply not the case. Are there ones that do know? Of course. Are there ones that are just spamming? To be sure. But to say that they deserve, any of them, to have their businesses have to wait a year or more to recover is just simply an ethics line I think Google has crossed. Slaps are one thing. Demolition is another.
This leads me to the point you made about multi-channel and diversity. Again easy to say from the point of view of a digital marketer. Small business owners however have limited capital and most can only afford a small amount of diversity. To fault them because they cannot broadly attack a digital marketing plan is like saying that guy who relies on local TV ads is a bad businessman because he also does not do radio, billboards, PPC, YELP, etc etc These things all cost money that many do not have to invest.
As for the analolgy, I can see your points, but still feel it is a valid one. If you cannot rebuild your business and you cannot move it, what are you supposed to do? Oh right pay for ads. Paying for ads means you have to invest a lot more money you likely don’t have, so yes I can still sell out of my website but in Google unless I pay money (typically a lot of money) no one is going to find it in the first place. So that is mostly an argument of semantics that aren’t valid for the real world.
On negative SEO I am going to have to respectfully disagree as your statement is untrue “Very few people in the industry have been able to cite real examples of websites affected long-term by negative SEO. And those who have rely mostly on speculation and loose logic. ” many have been able to show it and we have had audit clients who have experienced it who we help get back on track. Negative link SEO does exist and is used.
Appreciate the comments. However, our viewpoints are very different.
Joe Hall says
Wow, great post…. One question:
This seems like a plausible interpretation of what we know…. But has anyone actually seen Penguin applied to a brand new domain that doesn’t have any old URLs redirected??
Kristine Schachinger says
Thanks Joe!
This was one of John Mueller ‘s revelations. While I don’t know of a site that specifically had this, I do know many people, personally and from reading forums, who would move to a new site and find the new site obliterated in a typically 3 to 4 month time frame with no idea why, so I think John was pretty accurate in this case. (John only recently revealed this (last 6 months I think)
I will see if I can find the John reference however. It was in a Google Hangout. On an in the wild example, maybe someone who reads these will have a site they worked on that it happened to as well and can confirm.