Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
Google-An update to our search algorithms - Copyright Related (insidesearch.blogspot.com)
94 points by ZanderEarth32 on Aug 10, 2012 | hide | past | favorite | 104 comments


This is wrong. Google should aim to provide the best possible result for the search. If that is an copyrighted videostream on a non-authorized site (e.g. a stream of all of the episodes of the series i'm googling for), this should be exactly the first result. And not a lame but authorized preview of 30 seconds.

Already found myself using duckduckgo in such cases, imagining the results were better.


I think your proposed policy is very short-sighted.

More than ever, thanks to the Internet and ideas like social networking and search engines, independent artists of whatever genre can compete directly with the industry behemoths on merit. These are exactly the kind of people copyright is supposed to help. This is the very essence of promoting the creation and distribution of new works!

If massive industry players like Google are permitted to turn a blind eye to the side effects of their vast resources and almost monopolistic influence, while at the same time making staggering amounts of money helping many people to infringe copyright, then all this does is squash the little guys. It gives all the power back to the industry giants who are big enough to throw their weight around anyway. You know, the ones who have been price gouging for decades and pushing DRM and hiring whole departments to issue takedown notices to anything that vaguely resembles a title of a song they once sold and funding organisations that threaten to sue just about anyone in one of the most flagrant violations of any justice system in recent memory?

Frankly, I think Google have been incredibly lucky that the arm's length/safe harbour philosophy has held up so strongly so far in the global legal landscape. Given that the very thing that makes them so potentially damaging to legal rightsholders is their scale, and they make vast sums of money because of that scale, it would not have been unreasonable to go down a different path and impose more of a burden on them in terms of preventing abuse of their systems to break the law.

If they voluntarily take reasonable steps in that direction anyway, it sends the right message about corporate social responsibility. That alone is worth orders of magnitude more to them than the eyeballs of seventeen people who are going to go use Duck Duck Go for their searches instead. But it also supports the people who actually created the works you apparently enjoy enough to search for them but not enough to pay for them, which is ultimately good for everyone except freeloaders, since it promotes creation of more work, which more people can then search for on Google, and more people can then enjoy.


You're assuming that legitimate sites that help independent artists won't receive many copyright takedown requests. It's difficult for sites to control what their users upload and they typically rely on the DMCA. If this system is abused, new legitimate sites that respect DMCA can still be buried.

This does level the playing field for Youtube. They've been facing issues with videos that have been filtered for content falling under fair use and over-aggressive labels making mistaken takedowns. A new user-contributed video startup will now have to develop the same filtering and protections, or they risk being buried by Google through this system.


You are assuming that having takedown notices does not correlate with a lack of quality. I don't have any inside information about this change in particular, but I'd guess that is a bad assumption. I'd bet that indeed, this signal is useful to predict search quality on some set of traffic, and that's why Google is using it.

There tends to be a high bar to meet to push out search quality changes at Google.


Even in the announcement, it's about "legitimate, quality sources". Legitimate comes first, it is there combined with quality, but in reality it isn't. The best videohosters out there aren't legitimate in the eyes of the copyright-holders.

How high quality is the linked and praised npr.org, which incorporates Youtube-Videos which arent playable "from some websites", including npr.org [1] (from my ip at least)?

I don't have the data. I can't have. But according to the argumentation of the announcement itself and my own judgement regarding the sites in question, this is not a "search quality change" with a high bar to meet, done by engineers wanting to improve the results. I bet this comes from lawyers, (internal?) politics or pressure from the copyright-industry.

[1] http://www.npr.org/blogs/therecord/2012/08/09/158525288/muse...


You don't have to pontificate on semantics, you can just see the list of sites that receive the most takedown links:

http://www.google.com/transparencyreport/removals/copyright/...

that list does correlate rather well with spammy content (stuffed links and lots of flash ads and popups), it just also happens to correlate well with sites you're looking for when you want a torrent. As long as they're still indexing these sites, they're probably still going to come up if you add "torrent" to your query, so I don't really see the problem.

The reality is, when most people are looking for a video, they are looking to find it on an official site, and not a streaming video site from china or a torrent site with 18 "download" buttons, none of which links to the actual torrent file download (it's in the plain text link). As long as they can still find the other content, you're still meeting everyone's needs and you've probably upped average searcher satisfaction.

Now, geographic restrictions on video playback would be a great search signal to incorporate (would googlebot start trying to play videostreams, though?). That shit is really annoying.


Does this account for takedown notices received by youtube by itself? No.


I bet Youtube gets more takedown notices than just about any other site. Are they going to delist Youtube?


If you see the list of sites that Google has received notices for, http://www.google.com/transparencyreport/removals/copyright/...

The torrent sites and file sharing sites are aplenty in there. Are you saying they are low quality? It kinda seems obvious that the site that has the best torrents/files will have the highest quality and hence receive the most takedown notices.


Does this mean Google will never surface YouTube in its search results? That is probably the largest and most known source of copyright infringing material


Heh yeah, that is amusingly unaddressed


YouTube follows the DMCA (and does ContentID or whatever). Google search probably doesn't get very many requests to remove links to YouTube.

This policy shouldn't have much impact at all on any large site that discourages copyright violations and responds promptly to DMCA takedowns, because it isn't worth bothering Google Search about that content.


I agree this is probably what's happening but I'm worried this might change in the future. Right now I think all that happens is that the link is removed from the search results but if the site itself is also penalized, I'm afraid content owners can now see the value of sending both a DMCA and copyright takedown notice simultaneously.


no, this is for take down notices on search results. Wherever youtube is, it's pretty far down the list:

http://www.google.com/transparencyreport/removals/copyright/...


Not until they're forced, and likely they'd only listen to the Supreme Court on that point.


Haha, Youtube seems exempt from most filters - I get completely unrelated videos in the top 2-3 spots all the time. Come to think of it, that's pretty sad...


There are a lot of interesting signals for web spam and poor web content. I don't know if this one is very good. In particular I see this scenario:

1) Google algorithmically genreates take down notices on youtube, they move this over to search results.

2) Algorithms 'err on the side of caution' with regard to fair use.

3) Every page that quotes or excerpts a copyrighted work gets flagged.

4) So Google 'manually' makes exceptions for sites they strongly believe won't engage in poor behavior (NY Times, Techcrunch, whatever)

5) No new web site that reviews products or provides critical analysis ever makes it to Google's front page.

That might be a stretch, the auto-flag stuff on YouTube is out of control, and then trying to use that as a signal in results is just inviting abuse. Black hat SEOs are malicious enough without dealing with 'Copyright joejobs'

[ Full disclosure: I work at a search engine blekko.com ]


This has nothing to do with search quality. This is just Google bowing down to big copyright. They have done it before with the autocomplete feature, censoring many suggested terms.

They have been asking for this for a long time now. "De-ranking" is number one on this proposal: http://www.scribd.com/doc/79607883/Proposals-to-Search-Engin...

It seems Google has cushioned this in sweet words, as to not make it blatantly obvious.

These sites were very high on the rankings because people click them (and rarely return to search further). Google simply aligned its search results with peoples needs.

Google is enabling media companies in their delusions, when they could be destroying them. They might end up as a casualty.


I think you and I have different working definitions of 'search quality'. My definition is that the sites you find by searching for something give you the information you want.

I think 'bowing to big copyright' is no different than 'bowing to Chinese censors' or 'bowing to Administration staffers' or 'bowing to conservative thinkers'. All of them affect what results you get vs what you asked for. That those web pages have information that some other folks don't want you to see, is a discussion between page provider and complainer, not a fight the search engine should get into.

Using blekko.com as an example. You could create a slashtag with all the best torrent sites you can find on the web, and then you and anyone else who uses your slashtag could be searching all those sites for what is useful information to them. As a copyright holder they could search those sites too (and presumably they do) and attempt to take action against the sites if they chose to. The search engine is a window between two spaces, and while sure as a choke point it provides an easy target for those would would want to control the greater masses, it doesn't improve the 'quality' of the service when that occurs. It is of demonstrably lower quality so some folks.


I think we have the same definitions. I was just being unclear. My intent was to express that their change was not motivated by improving search quality.


Companies are delusional for submitting DMCA takedowns?


They are delusional for thinking strong-arming Google into censoring "pirate sites" and having it operate search dogs that crawl YouTube for anything that reeks of copyright will magically preserve their role as middlemen in a world with internet connectivity and cause customers everywhere to submit CC details to their subpar offerings.

Of course, none of that is going to happen. I'm just complaining that Google feels the need to join the bandwagon when it could be embracing the change.


You actually think Google with all of its resources and money is actually beholden to some always there and invisible bad group representing the music industry set to the destroy the world? I think you are probably mistaken, they are actually doing it to improve legal search results more prominently being displayed. Also there isn't any change to embrace, copyright infringement is still illegal, even if it is easy to get away with.


There is an alternative theory. Google isn't being strongarmed but they also aren't trying to improve search results. Instead they're trying to build moats around products like Youtube. By appeasing the content owners, the favor might be returned with, for example, exclusive content just for Youtube.

Note: I'm not saying this is the case.


I wonder what the secondary incentive effects of this will be. I see three possibilities:

1. Encourage copyright owners to send more takedowns to Google Search, since those takedowns will be "more powerful".

2. Encourage targeted sites to send more counter-notifications since a Google Search takedown has an effect on an entire site's ranking, not just a particular link.

3. Encourage shared sites (hosting providers, etc.) to shut down particular users or areas that get a lot of Google Search takedowns, to stop the spillover effect on the rest of the site.

I don't know which of these effects will matter the most, but I suspect at least one of them will be behind a significant unexpected consequence of this change.


Number 1 and 2 are most likely to happen...


Speaking of deteriorating Google search results, my latest peeve is when a search shows dozens of results from the same domain. There used to be the much more sensible "show more results from this domain" link. I have a hard time imagining why Google thinks the new way is better, my guess is some designers wanted to remove the link because they thought it was "cleaner".

More signs that designers, lawyers and MBAs are moving to the fore forcing engineers out of the way at Google Search.


Yes, this is a sad regression. In case anyone from inside Google is reading this and looking for a good example, try this search: https://www.google.com/search?q=scansnap+%22s1300i%22+%22s15...

The first 70 results are all from the same site!

It's a decent site, but most of the pages are barely relevant. I was searching multiple viewpoints that might explain why I would prefer one model of a scanner over another, and getting page after page from the same single source is much worse than the previous behaviour.


weird, I see 5 different domains (in incognito mode in chrome and private browsing in Firefox). The first three are all from one site, but after that there's fujitsu, amazon, lawyerist, and some kind of "snapsnapcommunity". There are more than a few decent looking reviews on the second page, too, which I'm not used to seeing in review searches...

There are quite a few from that one site, though.


Thanks for the detailed results. I get many more than 3, so your info inspired me to try figure out what's happening. I'm now more convinced that it's a bug rather than desired behaviour.

I first tried signing out, in case personalization was breaking things: no change. Then I tried "verbatim": no change. Then I tried changing the number of results from 100 to 10, and I see what you do: 3 from Documentsnap, 5 from various Fujitsu sites, then Amazon and Snapscancommunity.

Switch the number of results back to 100, and I'm back to getting more overwhelmed by Documentsnap. I counted again, and this time got 65 Documentsnap followed by 10 Fujitsu, then finally some variety.


I disagree, I really like the change.

If I'm searching on a programming problem, and google thinks the best two answers are both on stackoverflow, why shouldn't it show them both?

There needs to be a balance -- 10 links from stackoverflow in a row is no better than a "show more results from stackoverflow" link since it gives me no sense of what other sites contain -- but it also used to drive me crazy that the only option was either one result from each site or all results from one site. I'd rather have two or three from a single site if they seem like good answers.

"Dozens of results" from one site sounds like they're doing it very wrong sometimes, but the new way is much better in general.


As a designer, I decidedly resent that comment. Design is, by and large, supposed to be user-centric... and, obviously, this isn't a good situation for the user – so don't lump us in with the other people you blame.

More – I don't really see how design can be blamed for bad engineering management choices, likely forced by lawyers or MBAs (I also have my MBA, but I know what most MBAs are about).

Just say'n is all.


I noticed the same thing.


Same here. Noticed that repeatedly. I have absolutely no idea why this should be helpful at all.


I wonder if this has anything to do with Google wanting to server more and more paid content through Google Play and Youtube. Will Google be on our side or their side when the next SOPA bill appears?


I have no idea what "our side" is supposed to stand for in this context. Is "our side" the side that wants unlimited copyright infringement? I support that side as little as I support SOPA-like bills.


"our side" is the pro-freedom, pro-copying, information-wants-to-be-free, consumer side. "their side" is the pro-restriction, pro-enforcement, pro-1984 content producer side.

> I support that side as little as I support SOPA-like bills.

Theire is no "undecided" side. Either you support copyright enforcement against people who want to freely share information without a north-korea-style censorship body over their shoulders, or you dont. There is no middle ground. You cant support "a little bit" of censorship.


Haha. Well in that case no I strongly do not support what you so generously call "our side". But thanks for throwing my hat into your ring.

I support environments that enable and encourage the production of new creative works. I believe that copyright in some form is necessary to support such a system.

"A distinguishing characteristic of intellectual property is its "public good" aspect. While the cost of creating a work subject to copyright protection—for example, a book, movie, song, ballet, lithograph, map, business directory, or computer software program—is often high, the cost of reproducing the work, whether by the creator or by those to whom he has made it available, is often low. And once copies are available to others, it is often inexpensive for these users to make additional copies. If the copies made by the creator of the work are priced at or close to marginal cost, others may be discouraged from making copies, but the creator’s total revenues may not be sufficient to cover the cost of creating the work. Copyright protection—the right of the copyright’s owner to prevent others from making copies—trades off the costs of limiting access to a work against the benefits of providing incentives to create the work in the first place. Striking the correct balance between access and incentives is the central problem in copyright law. For copyright law to promote economic efficiency, its principal legal doctrines must, at least approximately, maximize the benefits from creating additional works minus both the losses from limiting access and the costs of administering copyright protection." - Posner, 1989, An Economic Analysis of Copyright Law


While that is certainly a nice and well regarded model, it does not say much about what actually happens. It really only amounts to a proposition, and cannot be read as indicating a necessity. As Landes and Posner themselves later say:

"Economic analysis has come up short of providing either theoretical or empirical grounds for assessing the overall effect of intellectual property law on economic welfare."

-- 'The economic structure of intellectual property law'; Landes, Posner; 2003. Conclusion, p422, s3.

That is, to spell it out, we do not know if intellectual monopoly law is doing any good at all. This is easy to see for oneself: there must be, and obviously are, costs -- legal, enforcement, search engine 'fixing' -- yet we have no idea how much the gain is. If there is a negative, but the positive is unknown, it is quite possible the sum is itself negative.


> I support environments that enable and encourage the production of new creative works

And when something comes along that makes it so easy to share/steal those creative works? What do you do to it?

It easy to say "I support free speech and the internet", "I don't support government surveillance of it's citizens" and "environments that enable and encourage the production of new creative works" because saying those things is meaningless.

Where do you stand when those things come in conflict with each other and tradeoffs need to be made?


Many of us derive our (high) salaries from building software that isn't open-sourced. Copyright is one important layer to prevent the SW from being used for free by everyone.

Even Google does this - it never open-sourced its core search infrastructure or google docs/mail/maps/etc products, and it monetizes them. And its open source products like chrome and android are really about creating more "attach" to its proprietary products.

Do those who hold the "pro-copying" view believe it's somehow bad that our work (software IP) results in proprietary source code that we are paid for?

Or is SW somehow different from someone who spends a lot to create a movie, book or song? I'm honestly curious!

(Personally, I'm against SOPA, and skeptical of SW patents, but don't have a problem with copyright).


What we do is different because our work is automagically protected from everything that threatens other forms of IP. And yet it's not at all hypocritical to play fast and easy with everyone else's IP!


I don't agree. There is plenty of middle ground, and I think most people tend to fall around the center of the spectrum. I for one don't support SOPA, yet support the notion of copyright.


The middle ground is imaginary.

For the types of copyright infringement everyone is probably thinking of (music, audiobooks, music videos, tv shows, movies, books) that are easy to turn into bits there is only one possible way to enforce copyright and that is large scale surveillance of the internet in order to police the content.

Maybe I'm missing something but I don't see much middle ground. Not when you think it all the way through to taking actual action to protect copyrighted works.

Besides SOPA style surveillance systems how do you enforce the notion of copyright that you support? It's too late to try and use social norms and make it uncool or embarrassing to have downloaded something without paying the creator. People will share things if they can unless someone stops them.

No one who isn't a strawman supports "unlimited copyright infringement" or doesn't want the artists we love to get paid, they just understand the tradeoffs that would have to be made to keep enforcing our current (historically recent) copyright system in the modern age and don't feel that abandoning some of the fundamentals of western democracy in order to temporarily protect the business models of those who currently pay artists is a worthwhile tradeoff.


The middle ground is certainly not imaginary. Life is not black or white. The people I associate with don't share things, because they almost universally recognize that if people don't financially support movie studios/music studios/authors - that this incredible flow of high quality content we all enjoy will disappear, almost overnight.

The right approach to managing copyright infringement is to continue to pursue the worst offenders (those who knowingly publish copyrighted content) while continuing to make that same content available through non-drm, inexpensive sources.

I applaud google's approach - which is to make it increasingly difficult to find these sites which persistently make copyright-infringing material available. Hopefully the other major search engines will do so as well; though, last time I checked, DuckDuckGo got a significant portion of it's content through Yahoo BOSS, and Yahoo get's it's content through Bing - so, in theory, if Bing adopts the same copyright friendly search indicators, then 90%+ of the search engines will now be obscuring this material)


Everyone is a publisher. You're in favor of lawsuits against people who run bittorrent clients in a swarm, then, for $22k a song, or even $1000 per song? Any amount enough to be worthwhile as a deterrent is punitive and has the potential to wreck someone's life.

Or what about blogs or forums with posted links to copyrighted material on filehosting sites?


The challenge here is to recognize there is a happy medium. " pursue the worst offenders (those who knowingly publish copyrighted content) "

There is a difference between someone who sells indexed warez/books/movies/music on a retail site, and someone running a bit torrent client. Aggressively pursue the first, and educate the second. Simply having the ISP send a warning notice of copyright infringement to the account holder of an IP address, without in any way communicating back to the rightsholder _who_ that IP Address holder was, is a nice medium. Note - just because it's easy to run a bit-torrent client sharing the latest GameOfThrones Books (all available via Kindle, or the library) doesn't mean it's legal (or even ethical).

Re: Posted Links to copyrighted material - depends on how organized / indexed those links are. If it's a casual site with a few links pointing out, clearly that falls under fair use. If it has carefully indexed/searchable database of 750,000 songs, and 35,000 movies,, and 250,000 books in such a way that you just have to visit that site, click a link, and download the content - well, perhaps there needs to be a conversation.

But reasonable people can come up with reasonable solutions. It doesn't have to be "All Sharing, All the Time" - nor does it have to be "Idiotic Draconian RIAA $22K/Song to some random bit torrent user"


It's easy to sit on the fence until you have to get specific. Everything you've said here is reasonable. Politician style reasonable. All the hard decisions that would need to be made to do anything in practice are covered by "educate the second" and "perhaps there needs to be a conversation".

In my opinion, you are wrong in expecting that these few large index/hosting sites or "worst offenders" will continue to be the bulk of the infringing traffic. We are moving away from that very quickly already.


There is, as you seem to realise to some extent, exactly one logical conclusion to the everyone-does-it, distributed-everything world you describe: prohibit the very act of conveying digital information in encrypted form, and require the infrastructure providers to help with identifying and prosecuting those who break the law.

Personally, I don't think that would be a very nice world to live in. That means effort has to be put into promoting legitimate alternatives and educating people about why these issues matter.

This has been done before, many times, with driving offences for example. Not so long ago, you could go past a pub at lunchtime and find plenty of obviously impaired people cheerfully getting into their cars to drive back to the office. Today, drunk-driving is socially unacceptable, licensed establishments run promotions for designated drivers, and police action is relatively rare because it is mostly unnecessary. This was achieved almost entirely through education, and in particular demonstrating the real consequences of the illegal act that do affect real people rather than allowing the perceptions of a "victimless crime" or "fighting the system" to continue unchallenged.

I see no reason a serious, credible campaign could not successfully explain that copyright is there to support the artists who create the works we want to enjoy and isn't just about lining the pockets of big businesses who have been price gouging since forever. If the laws were also changed to bring copyright terms back to sanity and those big businesses suffered a few high profile legal defeats over their track record of anti-competitive behaviour at the same time, a lot of good might result.

[Edit: To be clear, I'm not saying that this would completely eliminate all illegal copying. However, as I've just posted separately, I think it leads to a reasonable compromise that gives sensible options to people who just want to enjoy creative works and allows rightsholders to chase down large-scale infringement effectively without having to prohibit personal encrypted communications.]


Who defines large-scale infringement? Is several hundred torrents in violation of copyright (only a few active at a time) on someone's personal machine large-scale infringement? Several thousands torrents? A blog dedicated to linking to a handful of files on file download services each week in a very specific content domain? Hundreds per week?

What about private torrent trackers? What about file download sites like megaupload? What about forums? You expect them to police other people's content?

Strict copyright enforcement advocates love to talk about the cost of illegal sharing. What worthwhile software, movies, music, or books, in your opinion, have failed due to illegal filesharing, or would fail if copyright enforcement were limited to people directly selling copied content without permission?


Who defines large-scale infringement?

Why does it need anyone to define it?

There's a clear practical demarcation here, in that clearly artists can still make a living in the face of low-level background infringement between friends, but some projects are not commercially viable in the face of mass infringement.

What worthwhile software, movies, music, or books, in your opinion, have failed due to illegal filesharing, or would fail if copyright enforcement were limited to people directly selling copied content without permission?

Well, for one thing, there are small studios and independent artists giving up all the time because people rip them off and they don't have the resources to do anything about it or the scale to absorb the losses as a cost of doing business.

But that's not even the biggest problem. The biggest problem is the works that never get made in the first place.

Obviously you can never prove that something that doesn't exist would have done, but it doesn't take a genius to look at, say, the computer games industry and see that the modern PC gaming landscape is dominated by episode 17 of FPS clone #6 and sports game #24 2012 season, often complete with console-induced limitations on gameplay and audio/video standards.

Today, hardly any studio with the resources to make an innovative game with both novel gameplay and excellent production values is willing to risk it. When only 1 in 10 copies of your game gets paid for if you're lucky, it's not hard to see why. It's not that many people wouldn't enjoy and pay for such a game. It's not that such games don't have the potential to make huge amounts of money. It's just that everyone is so risk-averse that they'll choose the relatively safe bet every time, because the big hits don't bring enough profit to prop up a huge bust with the kinds of budget that AAA games command today.

Consequently, what innovation there is tends to come from games with relatively low production values or simple concepts that can scale programmatically without requiring a lot of expensive human creativity. Where is the next Baldur's Gate or Deus Ex? There is actually a team remaking the original BG series right now, and the next DE was... Deus Ex: Human Revolution last year.

It shouldn't be this way. With modern technology, independent artists or small groups can create work with better production values than ever. With the rise of the Internet, they have the ability to distribute those new works cheaper, faster and easier than at any time in the history of humanity. The world should be full of new titles. Web forums should be packed with success stories about how the creative people behind those new titles have finally been able to write the book or make the game or record the music they always had inside, and share it for the benefit of everyone. This should be possible because markets big enough to make it financially reasonable to develop those titles while still paying the rent should be enabled by things like social networking and search tools.

What is actually happening is that a few people are trying, every now and then there's a Minecraft-scale individual title or a PopCap-scale success story for a small studio made good, and most of the time the potential just dies, because a couple of days after launching a new work, someone has already ripped it off and put it up on a Warez site or torrent or whatever and that's where a lot of the attention is going.


It couldn't possibly be that those titles that you want to see are not being developed because few people want them?

http://vgsales.wikia.com/wiki/Video_game_industry#History_of...

You do not get to define market demand for particular types of games. People are willing to spend money on games.

The music industry is figuring out that, unlike the 90's, they can't put out a cd with 1 or 2 hits and expect people to buy the whole thing. So yes, sales are down. How much are they saving by shipping fewer CDs?

Book sales may be stagnant or declining, but units are up, and a similar argument applies: how much of the falling gross revenue is offset by reduced distribution costs?

How will any position on copyright enforcement cause people to forego watching the latest Twilight movie, or buying Harry Potter books, and instead buy the sort of high art or higher art that you seem to think they should be buying?

There is no shortage of people willing to buy the FPS clones, pulp fiction books, and popular music that you would decry. Your complaint lies with those people, not pirates.


It couldn't possibly be that those titles that you want to see are not being developed because few people want them?

Given that the titles I mentioned were so popular that they spawned entire series, highly rated by fans and critics alike, and as I mention they are still being emulated today... No, I don't your theory there is even slightly plausible.

And of course there have been other games in similar genres since then, some of which have been very commercially successful. But they've tended to come with obnoxious DRM, DLC and other silliness in an attempt to keep them that way despite the pirates.

My question isn't really about those specific titles, it's about innovation. The games I mentioned either defined or greatly advanced their respective genres for a generation of gamers. Where is the next Doom, the game whose basic concept has just never been done before on that kind of level?

The music industry is figuring out that, unlike the 90's, they can't put out a cd with 1 or 2 hits and expect people to buy the whole thing. So yes, sales are down. How much are they saving by shipping fewer CDs?

Book sales may be stagnant or declining, but units are up, and a similar argument applies: how much of the falling gross revenue is offset by reduced distribution costs?

Part of the trouble with this argument is that you seem to be assuming that most of the cost of creating and distributing good music and good books came from the physical distribution cost, which obviously doesn't apply in the same way for digital distribution. But that's not really the case.

For good music and good books -- and to be very clear, I am not talking about "high art" or any such nonsense, I'm just talking about work that is well made -- a large amount of the overall cost is up-front and doesn't change much just because of modern technologies. It's the human factor: having the right team and a well-equipped studio to handle the recording and production for your song, having a skilled editor and qualified proofreaders for a textbook, and so on.

Several of my close friends have worked in these industries in various capacities, and they paint a bleak picture of cut corners and cost savings in their industries today. Certainly the books I've bought in recent years myself have been sadly lacking compared to both the editorial quality and production values of a few years ago, and knowing what is going on behind the scenes it's all too clear how that is happening.

Sure, there's no excuse for bundling music into "albums" any more. Digitial distribution of individual pieces of music and automatic playlists in every media player application make the whole concept of an album nothing but an artificial marketing tool. Likewise the old fixed page sizes and tight page limits for books have little relevance in a digital world.

But the content is what's hard. Writing/performing good material, and elevating the results to the level of professional quality, is hard work and requires real skill. This isn't going to change. No computer AI algorithm is going to spot the way a paragraph is phrased awkwardly because it relies on an idea that isn't introduced definitely until three pages later, at least not any time soon.

There's a popular anti-copyright cliche that musical performers should just give their work away as advertising and hope to make a living playing live gigs. Maybe that works for those people, but how does a composer or a lyricist give a live performance? How do editors and researchers make a living when everything they do is about information? How does a level designer or the guy who sketches out the concept art for that great end of level boss that comes to symbolise the entire game?

The creative industries are vast machines today, and someone has to pay all these people during the creation/production stage of a work if that work is going to benefit from their skills and expertise. If the realisable profits become so small on a work that it's going to be commercially risky to make it at all, what actually happens is often that either it doesn't get made or it gets made without the help of these skilled people behind the scenes and winds up a worse product for it. And as I keep trying to point out, that doesn't help anyone, including the people who enjoy the work (or would have enjoyed it, if it had been better made).


I'll stipulate that some money is lost due to piracy, rather than get into a debate over how much.

What I don't agree with is that much good quality content is lost. If people aren't taking risks to make good quality content today, what changes if there's less piracy? Consumers still have a limited budget to spend on games, and a lot of people do still buy games, music, movies, books, just not the books you think they should buy. Those game sales figures, and lesser but still in the billions figures for books, music, and movies, show that people pay for entertainment. If they can't illegally copy things, maybe they buy x% more stuff, or maybe they're used to a lower budget for entertainment and so they don't spend any more, but rather they consume less. And why would they buy your good content rather than the arguably lower "quality" mass entertainment that you or I might not like, of which there is certainly plenty?

How do you intend to prevent non-commercial filesharing, or file sharing sites (forums, file hosting sites, torrent trackers), without destroying people's lives and having a chilling effect on filesharing in general?


> exactly one logical conclusion to the everyone-does-it, distributed-everything world you describe: prohibit the very act of conveying digital information in encrypted form, and require the infrastructure providers to help with identifying and prosecuting those who break the law

There is another logical conclusion: accept that since information is now easily shared that those who made their living by controlling the act of copying will be out of business soon.

Just like the canonical example of horse breeders and buggy makers being put out of business by the automobile. Like when the guild system collapsed and you could decide to try to earn a living as a blacksmith or carpenter without having to pay and get permission from the local guild.

These transitions aren't pretty, jobs are lost, industries collapse, but historically it has always turned out to be a necessary growing pain while something better has emerged. I certainly have a "the internet is one of great things humanity has done" bias but I still don't believe that this is an unrealistic vision.

I actually find it much more likely that artists will find a way to be paid and will adapt to a free exchange of bits than that we will find some good way to protect speech and freedom while still policing copyright. In that case you will always have powerful copyright interests with financial interests aligned against the advancement of an open internet. Combine that with needing to run a large scale education campaign the likes of anti-smoking or anti-drunk driving (that, because of the reputation of the copyright holders and a generation who things music is free, is getting harder every day).

I see the sense in your version, and it's not crazy. I just don't think we can pull it off. What we can do, since it's been done many times before, is let artists adapt to new technology and find a new business model.

And as 3D printers get better and better this is certainly a problem that's going to keep expanding.


There is another logical conclusion: accept that since information is now easily shared that those who made their living by controlling the act of copying will be out of business soon.

The trouble is that the people who make their living that way aren't just working for the big guys any more. There are little guys out there, whose work can be ripped off just as easily and who suffer public prejudice that was earned by the abusive policies of the big guys over the years, yet who have none of the advantages of the big guys to make up for it. When you put these people out of business, the works you value don't get made any more, because they get other jobs so they can have food to eat and put a roof over their family's heads.

Like when the guild system collapsed and you could decide to try to earn a living as a blacksmith or carpenter without having to pay and get permission from the local guild.

The difference in this case is that you're not just bringing down the guild, you're bringing down the blacksmith and the carpenter as well.

I actually find it much more likely that artists will find a way to be paid and will adapt to a free exchange of bits than that we will find some good way to protect speech and freedom while still policing copyright.

Perhaps you're right, and I'll be the first to support abolishing copyright if it turns out that there are better ways to incentivise artists without the same social cost. But the fact is that nothing is stopping people from using alternative business models today if they provide a better incentive than copyright, and almost no-one does.

There have been a few experiments with things like choose-your-own pricing, but they have had highly variable success rates. Almost all of the really successful projects were made by artists whose reputation was already built the old-fashioned way.

There are a few experiments with things like Kickstarter today, and I wish them luck too. However, for now they consider a $1,000,000 project a huge success, and it remains to be seen how many of these projects actually produce the kind of results that the "investors" expect and how sustainable the model might become.

Meanwhile, to put that in perspective, the budget for Batman: The Dark Knight Rises is reported to have been $250,000,000, and Star Wars: The Old Republic allegedly comes in around $200,000,000. No small, independent studio can build projects on that scale anyway, and while a MMORPG like SW:TOR has a certain natural barrier to being ripped off, the same can't be said for other genres of big budget game.

I see the sense in your version, and it's not crazy. I just don't think we can pull it off. What we can do, since it's been done many times before, is let artists adapt to new technology and find a new business model.

The trouble is, if we don't pull it off, those new business models are going to be things like always-online DRM schemes and locked-down hardware and walled garden app stores. Exactly none of these things ultimately results in better experiences for the public. They just happen to have defensible bottom lines for the businesses.


I also think it's good to point out that this is exactly what we mean when startup culture talks about "disrupting" an industry. That means putting the people who work in it out of a job. Robbing them of their livelihood.

We understand that this is true, but that it's still the right thing to do.

Why do artists get such special treatment? Is it because we all like some of them? Is it the huge PR campaign they've been running since cassette tapes and VCRs?


> The difference in this case is that you're not just bringing down the guild, you're bringing down the blacksmith and the carpenter as well.

I'm fairly sure that when these kinds of transitions happen the associated guild blacksmiths and carpenters, or artists thriving under royal patronage, or live musicians who did not adapt well to recording in the studio, are the ones who get the brunt of the pain. Although, as a group they always survive, while the hangers on and various big guys sometimes don't.

That's nitpicky though, I didn't mean to imply that there isn't/won't be significant damage to artists livelihoods, just that the damage to society and everyone else is greater if we continue down the road to the panopticon society necessary to continue to enforce our current copyright system.

> if they provide a better incentive than copyright, and almost no-one does

It's hard to beat a large scale monopoly distribution scheme. It's entirely possible that artists won't be able to make as much money under any new system as they did in the current one. Maybe there will be lowers highs and higher lows as the business moves away from being so hit-oriented. The one thing that's almost certain is that the distribution of music revenue among artists will be different, I find it more likely that the new technologies influence will be to flatten that distribution. Like you said, Kickstarter is a good example of an experiment that would do this if it does succeed.

I also agree that no one has figured out how to make blockbuster movies without a distribution monopoly to fund it, and they might never figure it out. Our generation's era of movies would probably be considered a bit of a golden age for high cost spectacle, like the old studio system was for serials and creating hollywood royalty.

> The trouble is, if we don't pull it off, those new business models are going to be things like always-online DRM schemes and locked-down hardware and walled garden app stores. Exactly none of these things ultimately results in better experiences for the public. They just happen to have defensible bottom lines for the businesses.

This is a good point, taking the path to locked-down hardware and DRM is an escape route that the existing industry can take/is taking. On reflection I agree, anti-SOPA/anti-surveillance sentiment pushes the industry to ramp up what Doctorow called the coming war on general purpose computation. Depressing thought, but at least some of the ideals that would motivate people to stop one will also motivate them to stop the other. And open hardware will still exist, and have benefits that consumers will like so that's winnable as well.


That's an awfully fuzzy definition of what's acceptable and what's not for something being dealt with at a political level.

> while continuing to make that same content available through non-drm, inexpensive sources

And who's going to force the rights-holders to do this?

> that this incredible flow of high quality content we all enjoy will disappear, almost overnight

Funny, art has survived quite a few shakeups in distribution and access throughout history and so far has kept getting better.

Don't get me wrong, this is a huge problem right now. Artists deserve to, and society needs them to, get paid. But people will share bits with each other in ways that are indistinguishable from free speech.

Going after the worst offenders works now, but those offenders are getting smaller and more distributed all the time. Even if they never go away, that group will soon be the biggest offenders. Trackerless torrents and distributed torrent search is here, and gaining in popularity. A lot of people in the HN community are working on new, easier ways to share bits with friends right now.

Can you define a middle ground that can identify and stop (or at least slow) the p2p distribution of copyrighted material that does not involve monitoring that p2p traffic to scan it for infringing content? That seems like a paradox.


>> Not when you think it all the way through to taking actual action to protect copyrighted works.

I think copyright protection is very possible without "abandoning some of the fundamentals of western democracy."

I suppose if I didn't then I would agree with you. I'm not so concerned with some individuals obtaining digital content without paying for it (I agree this would be basically impossible to enforce without trampling on civil liberties), as I am with companies systematically ripping off copyrighted work and re-selling it as their own. In the latter case, I would argue that copyright can quite easily be enforced by litigation within the existing system, without any threat to individual freedom.


I agree, but as things continue to change?

(will link to comment here http://news.ycombinator.com/item?id=4368387 rather than typing it again)


The middle ground is supporting copyright law, but not expecting to have 100% enforcement of it. This is exactly what we have right now.


And as the infringement moves to a more distributed network? When there aren't Kim Dotcoms to take down? That's where things are going right now, because of technological improvement and the current selective law enforcement we have right now.

That's what this conversation is about I thought, what we have right now is a system in transition.


The big problem for rightsholders with copyright infringement on the Internet is scale. In the anonymised but highly connected world of today's Internet, one site hosting infringing content can easily supply it to thousands of people within a matter of hours, and one P2P network can involve numerous people each helping the others to share infringing copies without even knowing who those others are.

The thing you keep ignoring is that this only works because of the public but anonymous nature of sharing material using these tools. You can't cause damage on that kind of scale if you're only sharing between a few friends that you can immediately identify, and the low level of infringement that such an arrangement might support is little different from the old days of trading music tapes in the school playground.

In practice, the realisable value of a major copyright-protected work, the kind of thing that costs millions to make and sells very many tickets/copies/whatever, is mostly collected within the first few days anyway. If a DRM system on a game holds off mass infringement for even a few weeks before the cracks come out, it's probably achieved 90+% of its potential. If a movie studio can keep a decent copy of a new blockbuster off the torrents even past the opening weekend, that's a huge benefit. Similarly, if rightsholders could reduce copyright infringement to something that really was a social activity rather than a massive industrial exercise, the benefits would be enormous even if that low level of illegal copying was still going on in the background.

So, all they have to do to defeat all these hypothetical future scenarios of yours is sign up for the same public but anonymous networks, record who is providing and/or downloading infringing material via their node, and then bring legal action against them both to reclaim their costs and actual damages and to identify the next links in the chain. Given that at this point we are talking about people who are known to have been breaking the law, I don't have a problem with the legal system providing for modest and realistic assumptions about actual damages but also awarding substantial costs to make these kinds of investigations and legitimate legal actions financially viable. Given reasonable safeguards to protect genuinely accidental/occasional indiscretions, I also don't have a problem with somewhat heavyweight actions like enlisting the help of ISPs to trace content that is now known to have been infringing back to its earlier sources, or imposing penalties on services that are known to be used for say anonymising transmissions but refuse to co-operate when an illegal action has been identified.

It will be harder to do this than just cutting off a handful of obvious, high-profile targets today, of course, but just as no DRM system can completely protect a movie that you can actually watch, so no distributed P2P system can completely anonymise where traffic came from. Just make sure any costs associated with these additional burdens are borne only by those who are found in court to have broken the law, and you probably have an effective deterrent that really is based on actual damages and measurable costs rather than absurd artificial estimates.


People still pay for movies, music, and SW today, so our current balance still creates economic rewards for production, despite piracy. Would you call our society today a "SOPA-style surveillance system" ?


Not at all, although I would argue that our current system today is in serious transition. Sharing is getting easier and more distributed, that's what's prompting the SOPA style solutions. Staying where we are now isn't an option thanks to the HN crowd continuously working on new ways to connect and share bits with their social circles.


Your mixing a lot of different things. I support copyright but don't support SOPA. I'm pro-consumer and freedom but believe content creators (software, music, film etc.) should be allowed to protect their content (to a certain point).

There is a big difference between a free exchange of information and wanting everything available to you for free with no restrictions.

And copyright != censorship. North Korea's big problem isn't copyright enforcement. Drawing a comparison between North Korea and people who support copyright is a stupid exaggeration.


If you attempt to force me into a binary decision like that, you aren't going to like what I decide.


How does this work for countries with different copyright laws?


So if you want to decrease a competitor's search engine placement, would you just have to file C&D notices on them?

I don't see how the amount of C&D notices correlates with value to users. Google does not appear to be benefiting its users in doing this.


You'd probably have to file thousands of takedowns and hope the site doesn't challenge them.


Also, Google outright rejects some dmca requests and Google also releases data about the actions of copyright owners and DMCA activity on http://www.google.com/transparencyreport/removals/copyright/. So even if not all abuses were caught they would at least be published for public scrutiny.


My first reaction on hearing this is the by demoting unauthorized content they will end up indirectly promoting authorized content.

And I don't know how I feel about this. From what we've seen with Youtube where unwarranted claims have taken down videos very much under fair use, I don't want Google automatically demoting search results because of a claim made by another party.

I foresee this causing no small amount of contention.


Google has not shown that it is able to competently handle copyright complaints. YouTube copyright take down notices happen all the time for legitimate content, chances are a similar ratio of false positives for site content.


Sounds like the path to breaking Google's "monopoly" has just been revealed...

Seriously, unless it's just the faintest hint of influence I can see this blowing up in their face. Takedown notices are too ubiquitous and too often bogus.


http://dmcarank.staticloud.com

DMCARank is a Google Custom search that only displays results from the top 50 domains with a high number of DMCA takedown requests (http://www.google.com/transparencyreport/removals/copyright/...).


In addition to this being a dubious signal for measuring result quality, this could have a chilling effect for sites concerned about SEO. We've seen the bizarre rain-dance that businesses are already willing to do to try to improve their position in Google results, and now we can add "avoid fair use" to that dance.


So I guess YouTube won't show up in search results anymore. #doublestandard


right?? But obviously, this wont happen, and I don't think that's fair.


Won't this impact YouTube dramatically?


FTA:

> Starting next week, we will begin taking into account a new signal in our rankings: the number of valid copyright removal notices we receive for any given site.

Following the link, you get to this page of stats ( http://www.google.com/transparencyreport/removals/copyright/... ) on take-down requests. If that page is what they make their basis on, then YouTube doesn't crack the top pages, so I would guess that it won't be hurt too badly.

Although, I have no idea if their count for YouTube is accurate or not. It's not like they wouldn't have an interest in under-reporting the numbers.



read the FAQ for the site (or the "Whats included" box on overview page).

"The data below consists of the copyright removal requests we've received through our web form for Google Search. It is a partial historical record that includes more than 95% of the copyright removal requests that we have received for Google Search since July 2011."

In other words youtube data is not included. This is only for websearch


That's the point. If they are going to rank links to youtube the same way as they link any other sites (as gp is using as the basis of the question), they would only use search takedown requests as the signal, not requests that youtube receives directly.


YouTube responds to DMCA requests so I assume copyright holders would contact them first, and not need to send notices to Google (search).


It's not about the site responding to DCMA requests, because how would Google know about this? This about how many DCMA requests Google gets to delist a search result I believe.


Right. What I think the parent comment is saying is that if they have contacted YouTube directly, Google (the search engine) would not get served with a take-down notice... YouTube would and it would have no influence on Google Rank.


For smaller sites, why would rights-holders bother trying to contact the site when they can just get it delisted from google?


I never mentioned smaller sites. Still, if you mean a smaller site operating like YouTube, contacting them directly would allow it to be taken off the internet rather than just out of Google results. Still, they might contact Google as well, and thus harm their rank.


Indeed. There's no incentive for rightsholders not to hedge their bets, and so even well-meaning user-generated content sites will suffer. Unless they're google properties, presumably.


There's some room for it to be a left hand vs right hand thing. That is, if the YouTube portion of Google is responsive to takedown notices, then the Google Search portion of Google isn't getting notices to remove those pages from the index.


It might "impact" YouTube's competitors even more dramatically.


If if YouTube does receive a high level of copyright notices, you can bet they have a special case for ranking YouTube videos, just because they own it.


So when I google an artist/song, someone's upload on youtube would not be in the first three results?


Copyright wars begin in earnest...


And a power vacuum in search created.


Exactly what I was thinking. Not sure how Bing and DuckDuckGo stack up but it might create an opening for a new player also - granted search is probably still the toughest game to get into.



This can be disastrous for user generated content websites.


Oh man, they should've never started with copyright removals in the first place (although I get that it's near impossible to do). This new filter has the same abuse potential as "negative SEO", where competitors posted so many spam links to good sites that they were dropped from the first page (with the competitor's site ranking higher as a result).


What happens if you have two pages, each listing the takedown notices applied to the other? Seed the pages periodically and wouldn't you get a pretty good measure of the popularity of your taken-down links by ranking them based on how often they are taken down?


This will mean ore traffic for http://www.filecrop.com and http://www.filestube.com.


Sounds like this might make it harder for companies to actually find websites posting 'stolen' content. Just saying.


With Google increasing it's content footprint over the years, it's interesting to see how the search group treats other Google groups. It's entirely possible to spend a day on the internet without leaving Google web properties (except hn, of course)




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: