Showing posts with label Technology. Show all posts
Showing posts with label Technology. Show all posts

Sunday, January 30, 2022

Why Did Spotify Choose Joe Rogan Over Neil Young? Hint: It’s Not A Music Company

(By Travis M. Andrews, Washington Post, 28 January 2022)

 

Neil Young, left, and Joe Rogan. (AP)

In one corner was Joe Rogan, the stand-up comedian and former “Fear Factor” host turned provocative podcaster.  In the other stood Neil Young, the multi-Grammy-winning rock legend with a lifelong passion for progressive causes.  The battle lasted two days, and Rogan won without making a peep.

Young started the scuffle when he posted a letter to his website Monday, addressed to his manager and an executive at his record label, demanding that his music catalogue be removed from Spotify in response to “fake information about vaccines.”

Specifically, Young cited Joe Rogan — who hosts “The Joe Rogan Experience” podcast — and has suggested healthy, young people shouldn’t get vaccinated. After catching the coronavirus, Rogan also praised ivermectin, a medicine used to kill parasites in animals and humans that has no proven anti-viral benefits. “I want you to let Spotify know immediately TODAY that I want all my music off their platform,” he wrote. “They can have Rogan or Young. Not both.”

Two days later, without a word from Rogan, Spotify began the process of removing the famed rocker’s music, including his best-known hits such as “Heart of Gold,” “Harvest Moon” and “Rockin’ in the Free World.”  The speed of Spotify’s decision to sideline Young was jarring. So why did the company do it?  The answer is simple: This isn’t really a story about Rogan or Young. It’s a story about Spotify. And, despite public perception, Spotify isn’t a music company. It’s a tech company looking to maximize profits.

Spotify’s quest to dominate the podcast space

The company hasn’t been shy about its desire — in 2019, Spotify announced it was planning to spend up to $500 million to acquire companies “in the emerging podcast marketplace.”  That year it purchased Gimlet Media, home of podcasts such as “Reply All,” “Homecoming” and “Where Should We Begin? With Esther Perel,” for an estimated $230 million. It also spent more than $100 million on Anchor, a platform that lets users create and share their own podcasts.

The next year, Spotify spent nearly $200 million to acquire the Ringer and its suite of popular podcasts, such as “Binge Mode,” “The Press Box” and its founder’s “The Bill Simmons Podcast.” And, of course, it reportedly spent more than $100 million to acquire exclusive rights to a single show: the extremely popular, rabble-rousing “Joe Rogan Experience.”  “I think it comes down to, just frankly, business,” said John Simson, the program director for the business and entertainment program at American University. “In the music side of things, [Spotify is] paying out roughly 70 percent of all the revenue that comes in. It goes right back out as royalties. They’re looking for other places where the revenue split isn’t that dramatic. … Podcasts were certainly their go-to.”

The plan seems to be working. Spotify reportedly overtook Apple Podcasts last year to become the largest podcast provider in the United States.

Spotify’s strained relationship with musicians

As Spotify built its podcasting empire, it has been increasingly criticized by the musicians who use the platform. In December, rapper T-Pain tweeted a breakdown of how many streams it takes for a musician to make $1 on various services, pointing out that on Spotify it takes 315 while on Apple Music it’s 128. Several months earlier, artists and music industry workers, organized by the Union of Musicians and Allied Workers, protested outside Spotify offices around the world — bringing petitions signed by more than 28,000 people that were demanding, among other things, higher payouts for artists.

“I don’t think of any of these platforms as being music companies that actually care about music. I think of them like technology companies,” said Gabriel Teodros, a Seattle-based hip-hop artist who wrote a viral Substack blog in December titled “There’s no money in streaming.”  Even so, Teodros said he was surprised at the “swiftness” with which Spotify decided to remove Young’s music, rather than Rogan’s podcast. “I thought it might be a long, drawn-out thing.”

Other big-name artists have also feuded with Spotify — Taylor Swift pulled her music from the platform until it met her demands — but none seemed to spark widespread change. That leaves Teodros wondering if Young’s protest is “going to be a moment where public perception of public streaming platforms are forever altered, or is it just a blip?”

Young has received an outpouring of support from across the political and social spectrum: “I’m with #NeilYoung,” tweeted Geraldo Rivera. “Waiting on all the musicians to step up and back Neil Young. Where are you?” tweeted author Don Winslow.  It’s not that dropping Young won’t inflict any pain on Spotify. Most of his music is more than 18 months old, and older tunes have become popular during the pandemic. 

So it should come as no surprise that the day after Spotify announced the removal of Young’s catalogue, SiriusXM said it would revive “Neil Young Radio,” a channel dedicated to Young’s music and storytelling, for a brief stint.  “When you have an opportunity to present an iconic artist still at the height of his creativity, you don’t hesitate to do it, again,” Steve Blatter, the company’s senior vice president and general manager of music programming, said in a pointedly cheeky statement. “Outspoken, brave, and a true music icon, Neil Young is in a rare class of artists, and we are honored to collaborate with him to create a special audio experience for his fans.”

Young’s plea to other musicians

“I sincerely hope that other artists and record companies will move off the SPOTIFY platform and stop supporting SPOTIFY’s deadly misinformation about COVID,” Young wrote on his blog on Wednesday.  Whether anyone will follow remains to be seen. Many of the artists who could take up his battle cry — elder statesmen of rock with large enough catalogues to hurt the streaming service — no longer own their own music.  In the past few years, Bruce Springsteen, Bob Dylan, Paul Simon, Tina Turner, Stevie Nicks, the David Bowie estate and many, many more have sold their entire catalogues for large sums. Younger artists, including John Legend and Ryan Tedder, have begun joining in.

In most of these cases, the artist sold both the publishing and the recording copyrights. That means, unless they have a special clause around how their music is used, they don’t have any power to dictate where their tunes appear. And Simson, the American University professor, said such clauses are rare. “The reason [these companies] are paying all that money is that these streaming services are driving up value” of those catalogues.

In his blog post, Young wrote that removing his music from Spotify will equate to “losing 60% of my world wide streaming income.”  So while other artists — particularly his contemporaries — rallying around the legend and pulling their music from the platform might sound like a nice rock-and-roll idea, it’s probably not going to happen.

Is losing one artist enough to force Spotify to change?

Then there’s the question of how much impact a single artist can have. The numbers look staggering. The Weeknd, an extreme outlier, currently garners 86.6 million monthly listeners. Adele has 60 million. Drake has about 53.6 million monthly listeners. Taylor Swift has about 54 million; BTS has 42.3 million.

If one or two of them pulled their music, how many of Spotify’s 172 million subscribers would actually delete their accounts? How many of its 381 million monthly users would stop listening?  “Spotify is probably counting on the inertia aspect. Once you’re on a particular streaming platform, you’re likely to stay there because you’ve got your playlists, you’re familiar with it,” Simson said. “It just feels scary to all of a sudden have to move.”

And those are just the top artists. What about everyone else? As Eve 6 frontman Max Collins sarcastically tweeted, “if spotify doesn’t take neil young seriously i bet they’ll heed the demands of eve6.”

Now consider that Rogan has an estimated 11 million listeners per episode. He usually posts four to five of them each week, and they frequently last longer than three hours.  When Spotify bought Rogan’s podcast, Stephanie Liu, an analyst with the research firm Forrester, told the New York Times, “This is part of Spotify’s bigger bet on podcasts. Spotify is buying not only Joe Rogan’s extensive and future content library, but also his loyal audience.”

To retain that audience, they need Rogan. Plus — and this is key — he’s exclusive to Spotify. Very few musical artists are. Neil Young’s albums are on Amazon, Apple and several other services. Rogan’s library is only on Spotify. You don’t need Spotify to listen to Young, but you do need it to listen to Rogan.

The power of Joe Rogan

“If podcasting is Spotify’s biggest strategic bet, then Joe Rogan is the biggest piece of that,” said Tatiana Cirisano, a music industry analyst and consultant at MIDiA Research. “Other podcasters might be looking at this and wondering, ‘Is Spotify safe for what I want to say?’ ”  She added that while Rogan’s audience may be large, it’s also narrow. His audience skews young and male. He plays the role of provocateur, beholden to no political belief system. While that obviously appeals to his fans, it’s unlikely those who don’t agree with him are tuning in.

“It’s a lot easier to serve a huge audience of music fans than it is to serve a huge audience of podcast listeners. [A] music genre isn’t a polarizing thing,” Cirisano said, adding that while people may listen to various genres of music, they’re much less likely to listen to podcasts across the political spectrum.  Losing an artist doesn’t necessarily mean losing all the fans of that artist. But lose Rogan, and his listeners aren’t likely to switch to Michelle Obama’s podcast, which is also on Spotify.

Joe Rogan is using his wildly popular podcast to question vaccines. Experts are fighting back.

Cirisano said this could be a “crucial moment” for Spotify, and that Young had forced them to choose between two influential talents.  She is, however, doubtful that Young’s move will persuade many people to quit Spotify.  “I think it takes a lot for people to switch platforms,” Cirisano said. “I’m not sure if anyone aside from the top 1 percent of Neil Young stans are going to do that.”

https://www.washingtonpost.com/arts-entertainment/2022/01/28/spotify-joe-rogan-neil-young/

Sunday, October 18, 2015

‘Steve Jobs’ And The Secular Ritual Of Going To The Movies

(By Ann Hornaday, Washington Post, 15 October 2015)

“Please remember to turn off your electronic devices.”  That’s a familiar refrain before movie screenings these days, but it had particular piquancy at the Monday night preview of “Steve Jobs,” the highly anticipated drama about the Apple co-founder, and the guy who made those electronic devices so hard to turn off in the first place.  Jobs, played in the film by Michael Fassbender as a gifted but haunted Shakespearean figure, never set out to destroy the movie business; indeed his purchase of George Lucas’s computer animation company — a little outfit known as Pixar — helped usher in a mini-Golden Age of storytelling and audacious creativity to the medium. But there’s no doubt that, in designing devices so intuitive and beautiful that they became extensions of the user’s psychic and physical self, Jobs also helped create a generation of second-screeners, happy to consume sound, images and stories on their TVs, laptops, phones and, heaven forfend, wristwatches.

Which makes it doubly piquant — deliciously ironic, even — that, when Washington’s newest Landmark Theatres location, Atlantic Plumbing Cinema, opens this weekend, it will be showing “Steve Jobs” in all six of its small, plushly appointed auditoriums.  “It is a fun irony,” said Landmark’s president and chief executive, Ted Mundorff, who noted that Apple didn’t impact the film industry directly, but it greatly influenced consumers’ expectations regarding how and when they see movies. Just as symbolically zeitgeisty as the all-Jobs program at Atlantic Plumbing is the fact that Landmark’s Bethesda Row Cinema is opening “Beasts of No Nation” the very same day it’s being made available on Netflix.
But amid all these technological death knells for the theatrical experience, it’s possible to glimpse a startling degree of saving grace — at least for Landmark, which specializes in films that appeal to people who consume movies the way they consume cuisine: not concession-counter junk food and Big Gulps, but artisanal fare and small-batch cocktails. (Which, not coincidentally, are being served at the theaters’ cafes).  There’s a critical mass of those audiences in Washington, which is why Landmark is doubling down here, opening Atlantic Plumbing this weekend, renovating the newly acquired West End Cinema and preparing to open a theater in NoMa. The company is part of a theater-building boom in the area that includes the Angelika, ArcLight and iPic theater chains, all of which are responding to the fact that — Netflix, peak TV and Jobs’s seductive devices be damned — we’re still going to the movies.

That fact isn’t lost on “Steve Jobs” screenwriter Aaron Sorkin, who started as a playwright and became famous for such TV shows as “The West Wing” and HBO’s “The Newsroom,” and who is dedicated to making the kind of smart, sophisticated, mid-budget dramas for grown-ups that are increasingly rare in Hollywood — which, partly in response to the siren call of shrinking home screens, has been striving to make movies bigger, louder and more infantilized.  Sorkin was caught up in a tech-centric maelstrom of his own last year when hackers — believed by the U.S. government to be based in North Korea — tapped into the computer system at Sony Pictures Entertainment; executives’ contentious e-mail negotiations regarding his “Steve Jobs” script were among the most publicized outtakes from the episode (the film wound up going to Universal Pictures). One of the hack’s most poignant revelations was how precarious films such as “Steve Jobs” are within a blockbuster-driven business model.
“They are precarious,” Sorkin told me in a phone conversation. “Ironically, this movie had a relatively smooth path to the screen. I’m not exactly sure why, but this kind of movie is a bigger gamble for a studio. The studio would feel more comfortable spending $150 million than spending $30 million. With $150 million, they know exactly how to market it and who to market it to. With this, there are some questions about who exactly is the audience for this movie.”  With “Steve Jobs” and others like it, Sorkin said, “the job of the movie isn’t to make a ton of money for the studio, the job of the movie is to not lose money.”

Which brings us to yet another delicious irony: “Steve Jobs” is making money. It earned more than half a million dollars when it opened in limited release last weekend, making it the 15th-highest earner pre-theater in history. After opening in Washington and 24 other markets, it will arrive on more than 2,000 screens next week, garnering earned awareness in word of mouth, strong reviews and Oscar buzz along the way.  This is the same strategy that made “Birdman,” “The Imitation Game” and “The Theory of Everything” local hits last year and that Mundorff, for one, is counting on again as awards season gets underway in earnest. “Our box office goes up every year,” he said, noting that overall industry earnings increased by 4 percent in 2015. “And I’m not seeing any trend going the other way.”
This is usually the moment when a frequent advocate for big-C cinema makes an impassioned case for the technical and aesthetic superiority of the theatrical experience. There’s no doubt that “Steve Jobs,” directed by Danny Boyle with an ingenious visual design using old-fashioned film stock and digital photography, benefits from the scale, detail and immersion that theaters provide. Almost word for word, Mundorff and Sorkin expressed an identical, shared belief in the transportive powers of sitting with a group of strangers, waiting for the lights to go down and for the screen to flicker to life.

But that experience isn’t — or at least isn’t only — an aesthetic one. It’s an emotional one. It’s not only the sounds and images that come to overwhelming life on the big screen that people crave. It’s the strong feelings — empathy, disdain, pity, longing — that envelop them as a result. That same need for sentient connection, not just information or cool graphics, is something Jobs understood better than anyone, as he endlessly fussed over round-cornered rectangles and fonts, in search of a machine people would not only utilize but love.
He succeeded brilliantly, of course, which is one of the reasons he’s worthy of a movie. But “Steve Jobs” leaves viewers with the lingering question: At what cost? One casualty of the wired-in, zoned-out culture Jobs was part of creating is precisely what the movie about him is helping to preserve: an occasion to make ourselves vulnerable. The secular ritual of going to the movies is one of the rare times when we can be alone, together, entering the same collective trance. Whether we emerge delighted, unsettled, astonished, we can’t go under fully until we’re bereft of our own devices.


 

 

 

Sunday, December 22, 2013

Netflix


Netflix's War On Mass Culture
(By Tim Wu, New Republic, 04 December 2013)

Given all the faces you see glued to computers, tablets, and cell phones, you might think that people watch much less television than they used to. You would be wrong. According to Nielsen, Americans on average consume nearly five hours of TV every day, a number that has actually gone up since the 1990s. That works out to about 34 hours a week and almost 1,800 hours per year, more than the average French person spends working. The vast majority of that time is still spent in front of a standard television, watching live or prescheduled programming. Two decades into the Internet revolution, despite economic challenges and cosmetic upgrades, the ancient regime survives, remaining both the nation’s dominant medium and one of its most immutable.

And that’s why what Netflix is trying to do is so audacious. For the past two years, the Silicon Valley company has been making a major push into original programming, putting out an ambitious slate of shows that have cost Netflix, which had profits of $17 million in 2012, hundreds of millions of dollars. Because of the relative quality of some of those series, such as “House of Cards” (a multiple Emmy winner) and “Orange Is the New Black,” they’ve been widely interpreted as part of an attempt to become another HBO. Because every episode of every show is made available to watch right away, they’re also seen as simply a new twist in on-demand viewing. But in fact the company has embarked upon a venture more radical than any before it. It may even be more radical than Netflix itself realizes.

History has shown that minor changes in viewing patterns can have enormous cultural spillovers. CNN can average as few as 400,000 viewers at any given moment—but imagine what the country might be like if cable news had never come along. Netflix’s gambit, aped by Amazon Studios and other imitators, is to replace the traditional TV model with one dictated by the behaviors and values of the Internet generation. Instead of feeding a collective identity with broadly appealing content, the streamers imagine a culture united by shared tastes rather than arbitrary time slots. Pursuing a strategy that runs counter to many of Hollywood’s most deep-seated hierarchies and norms, Netflix seeks nothing less than to reprogram Americans themselves. What will happen to our mass culture if it succeeds?  Vladimir Nabokov believed that humanity’s highest yearning ought to be to leave behind any desire to be up-to-date, to be unconcerned with what is happening now. As he put it in his notes to Pale Fire: “Time without consciousness—lower animal world; time with consciousness—man; consciousness without time—some still higher state.”

The business of entertainment has not generally shared Nabokov’s view. It values timeliness above all, creating a hierarchy so fundamental that it resembles natural law: New is better than old, live trumps prerecorded, original episodes always beat reruns. That’s overwhelmingly obvious in sports and news, and accounts for the manufactured ephemerality of reality and talent shows. Yet it is also implicit in dramas and sitcoms, with their premieres, finite seasons, and finales. The rule holds fast for film as well. From its opening weekend in major theaters, through nearly two years of “release windows,” a movie drifts downward through airlines, hotels, DVDs, cable and network television, and the Internet, decaying in perceived worth.

The desire to be current is in some sense human nature. But when it comes to viewing choices, it also arises from the specific history and revenue model of the entertainment business. In its early years, television was necessarily live, for the technology of broadcasting preceded effective and cheap recording technologies. The first popular shows, like “Amos ‘n’ Andy,” were short serial dramas designed to keep audiences on a fixed daily schedule, each episode ending with some aspect of the plot unresolved. If you missed an installment, you missed it forever and might lose the big story in the bargain.

In normal markets, the most popular products aren’t necessarily the most profitable (think Louis Vuitton). But on network television, where the prices charged for advertising depend on ratings, comparative popularity matters a lot. If some sense of newness or urgency can get viewers from the desired demographic to tune in to one channel rather than another, that can make the difference between success or failure. The upshot is a business whose highest ambition is to get enormous groups of people watching the same thing at the same time: “event television.”

Atop this eventocracy are productions like the Super Bowl or the Oscars, which by managing to grab much of the nation therefore command the highest ad rates, about $4 million and $2 million, respectively. That compares with the $77,000 per spot that “30 Rock,” a smart but under-watched series, commanded at the end of its run. The premium on audience size orients creative decisions toward an ideal embodied by a Jay Leno monologue, avoidant of controversy or anything too weird or challenging. TV shows, in the words of economist Harold Vogel, are “scheduled interruptions of marketing bulletins.” And television itself, as Walter Lippmann, a founder of this magazine, put it, has long been “the creature, the servant, and indeed the prostitute, of merchandising.”

The Internet—while it has its own desires for attention—has always been a different animal. One way or another, it tends to thwart efforts to gather lots of users at the same time and same virtual place. The first “YouTube Music Awards,” stuffed with celebrities, attracted 220,000 live viewers, compared with more than ten million for MTV’s version. During the men’s 100-meter-dash final at the London Olympics, Web viewers groaned as NBC’s Web video lapsed into “buffer mode.”

Online, people are far more loyal to their interests and obsessions than an externally imposed schedule. While they may end up seeing the same stuff as other viewers, it happens incrementally, through recommendation algorithms and personal endorsements relayed over Twitter feeds, Facebook posts, and e-mails. New content is like snowfall, some of it melting away, some of it sticking and gradually accumulating. The YouTube Music Awards may have been a bust as a live show, but within two weeks, the production had racked up 3.5 million views.

When I spoke with Netflix CEO Reed Hastings in August, I noticed a subtle but significant shift in nomenclature: He had begun to refer to the company not as a tech start-up or a new media venture, but instead as a “network.” To claim that mantle is not a trivial thing. The National Broadcasting Corporation (NBC) pioneered our understanding of what the concept means back in 1926, when it partnered with AT&T to create the first lasting national broadcast network. Until then, American home entertainment had been necessarily local—radio stations, technologically, only reached their host city or community. The founding idea of NBC was to offer a single, higher-quality product to the whole country. It was an idea of a piece with the late 1920s and 1930s, before fascism became unfashionable and nationalism was all the rage. A mighty and unifying medium fit with an era during which Fortune would praise Benito Mussolini as presenting “the virtue of force and centralized government acting without conflict for the whole nation at once.” The national network was an effective way to put people on a common daily cultural diet.

Claiming network status was also a bold move for Netflix just based on its track record alone; not so long ago, it was a struggling DVD rental company whose cachet came from its distinctive red envelopes and pretty good website. One wonders how much the shift really was planned, a question on which Hastings and chief content officer Ted Sarandos disagree. “When I met Reed in 1999,” Sarandos told me, “part of our first conversations were about the potential for original programming.” Hastings demurs, calling that “generous.” “What was planned all along was really just the evolution to streaming,” he says, “and thus the name of the company: Netflix, not DVDbymail.com.”

Netflix’s transition from delivering movies and TV shows through the U.S. Postal Service to beaming them over high-speed connections began in 2007 and is a well-known story. Less known is how Netflix found its way into the content business, a risky move that has embarrassed many tech firms. In the ’90s, Panasonic, a capable-enough maker of camcorders, acquired a precursor to Universal, only to have to jettison the entertainment studio a few year later. Around the same time, Microsoft, then at its most flush, blew billions creating content that for the most part vanished so fast that not even a Bing search could find it today.

But Netflix, without grabbing many headlines, had actually spent a long time preparing for its current chapter. While it is headquartered in Silicon Valley, the company opened an office in Beverly Hills in 2002, a bid to achieve a certain California bilingualism. Sarandos, who has overseen that southern outpost, spent his formative years working in a strip-mall video-rental shop and is upbeat and easy to talk to. He is a fluent Southern Californian, unlike Hastings, who’s known for his impatience with slow or muddy thinkers.  Throughout the early 2000s, Sarandos experimented with small content deals. Once, while attending a software convention, he ran into a guy named Stu Pollard who had self-financed a romantic comedy named Nice Guys Sleep Alone, the many extra copies of which he now had stored in his garage.  “He gave me his movie, and he said, ‘I’ve got ten thousand of these if you’re interested,’ ” Sarandos recalls. He watched the film, decided it wasn’t terrible, or at least “on par with a lot of the romantic comedies we were distributing.” Sarandos agreed to take 500 discs, pursuant to a revenue share, creating what might be called the first Netflix semi-exclusive.

Sarandos’s acquisitions budget, originally $100,000 a year, swelled as Netflix became a regular at Sundance and other film festivals. Under the name Red Envelope Entertainment, Netflix bought the rights to independent films such as Born into Brothels, a 2004 documentary about the children of Calcutta prostitutes (it won an Academy Award), and Super High Me, a documentary about the effects of smoking weed heavily for a month (sperm count and verbal SAT scores both went up; math scores suffered). When it acquired these films, Netflix added them to its own catalogue but did not keep the content entirely for itself, instead trying to distribute it as widely as possible. For Super High Me, that included sponsoring viewing parties for stoners.  In 2008, after acquiring about 115 films, Netflix folded Red Envelope and let go of several employees. Sarandos, at the time, gave good reasons for Netflix’s retreat. “The best role we play,” he said, “is connecting the film to the audience, not as a financier, not as a producer, not as an outside distributor or marketer.” It was the statement of a tech company sobering up.

Yet just a few years later, Netflix abruptly reversed course again. The company had finally passed 20 million subscribers. To thrive over the long term, it would need many more. At the same time, it now had enough scale to try a different way of using new content to lure them. “When a big company does a little bit of music, or a little bit of video, and it’s not essential to their future, it’s almost assured that they won’t do it well,” says Hastings. “It’s a dabble.” To make its first major original series, Netflix shelled out $100 million. It would not be dabbling.

In 2011, when independent studio Media Rights Capital shopped the American remake of a modestly successful British political drama named “House of Cards,” Netflix didn’t bother to attend its presentation to the networks. Instead, Sarandos got in touch with David Fincher, the Oscar-winning director of The Social Network, who’d been tapped to make the show. “We want the series,” Sarandos told him, “and I’m going to pitch you on why you should sell it to us.” Aware of the challenge of convincing a famous auteur to bring his talents to a medium more commonly known for cat videos, Netflix promised a lot: Fincher, though he’d never directed a TV series before, would enjoy enormous creative control. And rather than putting the show through the normal pilot process, the company would commit to two 13-episode seasons up front. It was nearly as aggressive with “Orange Is the New Black,” ordering a second season of the show—a subversive drama set in a women’s prison, featuring a notably motley cast—before the first was even available.

If those were big gambles, they were also calculated ones. Whatever it calls itself, Netflix still has tech-company DNA; its game, in part, is data. Much more so than a network that reaches viewers through a third-party cable operator like Comcast or Time Warner, it knows what its customers actually like and how they behave. To the consternation of entertainment reporters, Netflix never reveals just what its numbers say (or anything resembling ratings), but Sarandos says its process for “House of Cards” worked roughly like this: “We read lots of data to figure out how popular Kevin Spacey was over his entire output of movies. How many people actually highly rate four or five of them?” Then his team did the same for David Fincher. If you liked The Social Network, The Curious Case of Benjamin Button, and Fight Club, “you’re probably a Fincher fan—you probably don’t know it, but you are,” he says. Once the company has a sense of how many fans are out there, it can “more accurately predict the absolute market size for a show.” And when you can do that, you don’t have to worry about pandering to, or offending, the masses.

Right now, American viewers are averaging only about 45 minutes of Internet-streaming video per week, a blip in comparison with total television intake. Given that audiences trained for decades to respond to event-driven television, how realistic is it to expect more viewers to shift from traditional TV? John Steinbeck offered one answer: “It’s a hard thing to leave any deeply routined life, even if you hate it.” Any historian of consumer technology would add that machines change much faster than people.  Television in particular moves so slowly that the last time the concept of the network really came up for grabs was the late ’70s. That’s when Ted Turner (the Turner Broadcasting System), Pat Robertson (the Christian Broadcast Network), and the founders of HBO successfully used satellites to begin to beam programming to cable subscribers. The ensuing frenzy resulted in the launch of a dozen networks, including ESPN, MTV, CNN, Discovery, and Bravo. Most of those channels are still around, not necessarily because of the strength of their programming, but because the reigning content hierarchy has been so entrenched.

Netflix believes it has a powerful factor in its favor as it tries to change viewers’ habits. “Human beings like control,” says Sarandos. “To make all of America do the same thing at the same time is enormously inefficient, ridiculously expensive, and most of the time, not a very satisfying experience.” There is a freedom achieved when your options extend beyond that night’s offerings and the limited selection of past episodes that networks make available on demand. Specifically, it’s the freedom to only watch television you really enjoy. The crude novelty factor that compels people to try “Whitney” or “Smash” ultimately yields a lot of disappointed and frustrated viewers. An old episode of “Freaks and Geeks” or “The West Wing” might in fact be more worth your time—a message Netflix has pressed in a recent ad campaign promoting its collections of classic series and cult hits. Eventually—or so goes the strategy—people won’t be able to imagine having their options defined by a programming grid. Not coincidentally, Netflix has been vying with Amazon to become the premiere source of streaming series for young children, for whom having to wait for new episodes of their favorite shows to air is unfathomable.

While Netflix’s first few original series have been aimed at connoisseurs of high- or at least upper-middle-brow fare, its philosophy might be best captured by its co-production of “Derek,” a show that skews toward less sophisticated sensibilities. “Derek”is a Ricky Gervais sitcom revolving around the staff and residents of a small nursing home in England. The show, to put it mildly, does not have the usual indicia of widespread appeal. It might be described as the opposite of “Baywatch”—the setting is bleak, the stars ugly and often annoying, the dialogue sometimes incomprehensible to American ears.

And then there’s Gervais himself. He did serve for three years as the host of the Golden Globes, a paragon of event programming and water-cooler culture. Yet in that role, he was deemed a failure, his humor too edgy and offensive. Selling the masses on a series featuring Gervais playing the part of a weird man with greasy hair who likes hamster videos would be a losing proposition—but that’s not what Netflix is doing. To the company, it doesn’t matter if you’ve never heard of the show, or even know anyone who has. All that matters is that it wins the approval of Gervais loyalists, whom, the data must show, are a large enough Netflix population to justify the investment. Similarly, the names Luke Cage and Jessica Jones may mean nothing to you, but they do to comic-book fans, which is why Netflix just worked out a deal to create series based on them and two other Marvel superheroes.

Netflix’s transformation would of course be impossible without the path blazed by premium cable. HBO pioneered the subscription-fee model (though it collects from cable companies rather than directly from consumers) and its success made possible the specialized programming on other premium networks, like AMC and the rest. The DVD box set gave hard-core enthusiasts the first taste of the binge-viewing that is a Netflix trademark. The company’s achievement is to bring it all together and target the entire TV-watching population—not just a few selected die-hards, but every individual based on his or her own interests and obsessions.

And from that a picture of the not-too-distant TV future emerges. What remains of live programming is reserved for sports programming, breaking news stories, talent contests, and the big awards shows. Nearly all scripted shows become streaming shows, whether they are produced or aggregated by Netflix or Amazon, CBS or a (finally unbundled) HBO—or even an unexpected entrant such as Target, which recently launched a Netflix competitor. The new networks compete based on their ability to make the right original programming decisions and secure the best old shows, as well as the prescience of their recommendation engines. But ultimately they’re all just selling access to piles of content to be perused at the viewer’s desire. Oddly enough, it’s a vision that actually makes television a lot more like the rest of retail. Or, more specifically, not unlike the old-style video-rental stores where Sarandos started his career, but super-sized for a new era.

Through the sheer number of hours watched and the dictation of evening routines—not to mention the way people orient entire rooms around the shiny screens placed at the center of their homes—network television played a singular role in creating American mass culture over the last 60 years. It now does the same in sustaining its vestiges. In the absence of a generation-defining genre—the rock of the 1960s, the rap of the 1990s—today’s pop hits flit through radio dials and iTunes playlists, catchy but ephemeral. Blockbuster movies and books are few these days, and the windows during which they command widespread attention brief. But television, despite the fragmenting influence of the Web and proliferating cable channels, continues to bind us more than any other medium. That’s why, should Netflix and the other streamers even partially succeed at redefining the network as we know it, the effects will be so profound.

If modern American popular culture was built on a central pillar of mainstream entertainment flanked by smaller subcultures, what stands to replace it is a very different infrastructure, one comprising islands of fandom. With no standard daily cultural diet, we’ll tilt even more from a country united by shows like “I Love Lucy” or “Friends” toward one where people claim more personalized allegiances, such as to the particular bunch of viewers who are obsessed with “Game of Thrones” or who somehow find Ricky Gervais unfailingly hysterical, as opposed to painfully offensive.

The baby-boomer intellectuals who lament the erosion of shared values are right: Something will be lost in the transition. At the water cooler or wedding reception or cocktail party or kid’s soccer game, conversations that were once a venue for mutual experiences will become even more strained as chatter about last night’s overtime thriller or “Seinfeld” shenanigans is replaced by grasping for common ground. (“Have you heard of ‘The Defenders’? Yeah? What episode are you on?”) At a deeper level, a country already polarized by the echo chambers of ideologically driven journalism and social media will find itself with even less to agree on.

But it’s not all cause for dismay. Community lost can be community gained, and as mass culture weakens, it creates openings for the cohorts that can otherwise get crowded out. When you meet someone with the same particular passions and sensibility, the sense of connection can be profound. Smaller communities of fans, forged from shared perspectives, offer a more genuine sense of belonging than a national identity born of geographical happenstance.

Whether a future based fundamentally on fandom is superior in any objective sense is impossible to say. But it’s worth keeping in mind that the whole idea of one great entertainment medium that unites the country isn’t really that old a tradition, particularly American, nor necessarily noble. We may come to remember it as a twentieth-century quirk, born of particular business models and an obsession with national unity indelibly tied to darker projects. The whole ideal of “forging one people” is not entirely benevolent and has always been at odds with a country meant to be the home of the free.  Certainly, a culture where niche supplants mass hews closer to the original vision of the Americas, of a new continent truly open to whatever diverse and eccentric groups showed up. The United States was once, almost by definition, a place without a dominant national identity. As it revolutionizes television, Netflix is merely helping to return us to that past.

 

http://www.newrepublic.com/article/115687/netflixs-war-mass-culture?wpisrc=nl_lunchln




Netflix Takes On Hollywood With Original Shows
(By Cecilia Kang, Washington Post, 02 February 2013)
Tech giant Netflix is going Hollywood. As the dominant paid provider of streaming online videos, it now sees making its own videos as the key to its future.  This big bet — and an expensive one — turns the ever-evolving company into a chief rival of HBO and major television networks.  Chief executive Reed Hastings was in Washington last week to promote Netflix’ s $100 million Web-only series “House of Cards,” starring Kevin Spacey. He dropped by The Washington Post to talk about the future of television entertainment and the tensions he’ll have to sort out with his biggest frenemies — networks and the telecom providers that deliver Internet services like his to homes.
 
The company is regaining steam on Wall Street after a stock freefall last year, following the embarrassing mistake of prematurely canceling its DVD mail-order business. Hastings changed his mind and announced that the company will keep that service for at least a decade, he says now — or as long as the Postal Service survives.  Here’s an edited version of the discussion:

What’s in store for the next couple of years? Will you look more like NBC Universal or YouTube?
We want more members, more content and to serve more countries. The people at YouTube have that space figured out; it’s all ad supported. For us, we will license more movies, television shows and create more original content.
 
Why do you do original content? For buzz?
For subscriber enjoyment and the buzz. If there is more buzz, more people join.
 
But it seems awfully high-risk.
That’s how you differentiate. With on-demand, you can have doubles and not a home run. But networks can’t. That’s why they have to do pilots and pay for overhead. We don’t. We have incredible shows for the Hindi community and other audiences. The whole notion of what is a hit is different. We are about figure out what people are passionate about. We aren’t trying to program to the lowest common denominator. Linear TV has had a one-to-many broadcast, whether its NBC or HBO. We have more creative latitude.
 
What will the the market look like in five years?
Linear TV today will be like landline telephone. You’ll still have it. Many people will pay for it but won’t use it very much. The most communication will go to the mobile phone. Electronics will get better. There will be an iPhone 9 or iPhone 10, and it will be impossibly thin and have amazing resolution, and we’ll have incredible bandwidth.
 
We’ll have 4K TVs that will be cheap and have large screens. You will control your TV with your smartphone. So the smartphone will be the remote control for your car, give you diagnostics. It will open your house, and it will be your remote control for your life, too. You’ll buy channels like Netflix, Hulu and others on that remote control phone. And whatever screen, whether upstairs, downstairs or in a hotel, will recognize you from your mobile phone-centricity.
 
Who will own the pipes for Internet connections?
For residential, cable will have their own, fiber will have theirs, too. There will be radio stacks and different providers. The question is how much speed will there be and how much competition.
 
Do you think we will get detached from the monopoly cable provider?
Billing and bundling will be tricky. I don’t know to what degree the bundle will break up. More likely than not. HBO in the Nordics is competing as a stand-alone [offering]. The question is if the [cable providers] can handle the disruption.
 

Will your move into content push those changes?
I don’t think so. But we are becoming more like HBO faster than they are becoming like us. We were an Internet company, and then we became a content company. Maybe in the long run, there will be two great companies battling it out, and that’s fine. That’s good for everyone.
 
Talk about your relationship with the telecom ISPs. What are pain points in that business relationship ?
Right now, it’s not really painful at all. The customer experience is great. You click and you watch. In the long term, there is potential conflict because we’re capitalist and they’re capitalist and everyone wants to expand their profit pool.  ESPN and HBO get a percentage of total cable cost. Cable costs 70 bucks and ESPN gets like 6 bucks of that.  So we look at it and say, “Hey, there’s a $60 ISP bill that is hugely profitable for ISPs. Maybe we should get a part of that because [consumers] are getting broadband to get Netflix.”  They say, “One-third of our bits, our costs, are Netflix, and so Netflix should pay part of our costs.”  There will be some battle around there. Our basic view is that there is a safe medium that avoids all the [television] carriage battles that we’ve had over 15 years.
 
What are you doing to that safe medium?
We have Open Connect, how we connect to their networks. It’s servers that have all our discs. We bring the servers and connect them to their networks. We have to carry the bits to where they want, to each metro area, at our cost. The ISPs carry them. And we don’t charge them, and they don’t charge us.
 
Are they happy?
Small ISPs are thrilled. But the big guys, they are used to better deals than that and they don’t want smaller guys to have the same deal.  Consumers want a change in their cable relationship. No one is mad at the equipment makers. They don’t say Samsung is doing things wrong. It has nothing to do with the electronics. It has to do with service side. What’s hard is that businesses are interlocked between cable, satellite and long-term contracts [with networks]. They sign up for 10 years for ABC stuff and ESPN.  But we are changing that. We signed a deal with Disney where movies like Pixar and Lucas Films will only be available on the first pay window on Netflix starting in 2016.
 
Does it make sense to move in Apple’s direction and become a gateway for how users get video content — through a set-top box?
Consumers want a box with multiple services. They want Hulu and YouTube and ESPN. We’re trying to be like Google Maps, on every device.
 
What’s your relationship like with Amazon?
Great. We are doing great work with Amazon Web services. We compete on the retail side, bidding against each other for NBC and ABC and other networks. Competition is healthy. Different providers will have different content.
 
Will you every advertise on Netflix?
No. Our position is like HBO, to be a commercial-free network.
 
Why not? You already have a ton of information about users. You could target ads to them, too.
It depends on what you are trying to attract. Part of our proposition, like HBO, is to differentiate ourselves in a way so that we’re worth paying for. Being commercial-free is part of that proposition.
 
How much longer will you keep mailing DVDs?
It depends on how quickly the Postal Service has problems. Taxpayers soon will be bailing out the post office to a huge number. So we’ll stay in that business for at least a decade, because people still need the post office to deliver Social Security checks, medicine, etc.
 
Will you take user-generated content? Sports?
Don’t think so. YouTube is already so good at it, and it’s not part of our brand. Same thing with sports; we don’t think we will do that. Movies, TV shows are the main places we are focusing and adding more content and getting better. Knowing that you are in middle of a series and going home to watch the next episode of “Lost” or “Mad Men”is a good feeling. We want you to feel that all the time.
 
What do you need from Washington?
There is this ISP battle stuff. In an ideal case, we need nothing at all because it will all be worked out commercially. AT&T and Comcast in particular are very sophisticated with their regulatory mechanism. Yes, we compete with them on the video side. but we are also one of the main reasons people get broadband.
 
What makes you think you are driving broadband adoption?
In peak traffic on a Friday, 30 percent of it is Netflix.
 
But ISPs could say you gobble up so much bandwidth because your service is so bandwidth-intensive.
We don’t gobble anything. Their users choose to watch us. They sell a service to their members, and their members are using it.
 
What has surprised you the most about Washington?
How hard immigration is. In 1998, I worked hard on H-1B visas, and it’s been a long and hard-fought battle. I’m optimistic something will pass this year.
 

Comcast’s Deal With Netflix Makes Network Neutrality Obsolete
By Timothy B. Lee, Washington Post, 23 February 2014)
(Paul Sakuma / AP)(Paul Sakuma / AP)
For the past two decades, the Internet has operated as an unregulated, competitive free market. Given the tendency of networked industries to lapse into monopoly—think of AT&T's 70-year hold over telephone service, for example—that's a minor miracle. But recent developments are putting the Internet's decentralized architecture in danger.  In recent months, the nation's largest residential Internet service providers have been demanding payment to deliver Netflix traffic to their own customers. On Sunday, the Wall Street Journal reported that Netflix has agreed to the demands of the nation's largest broadband provider, Comcast. The change represents a fundamental shift in power in the Internet economy that threatens to undermine the competitive market structure that have served Internet users so well for the past two decades.

The deal will also transform the debate over network neutrality regulation. Officially, Comcast's deal with Netflix is about interconnection, not traffic discrimination. But it's hard to see a practical difference between this deal and the kind of tiered access that network neutrality advocates have long feared. Network neutrality advocates are going to have to go back to the drawing board.
The classic Internet

To understand what's going on, it's helpful to review the structure of the "classic" Internet.  This is is an idealized depiction of how the "classic" Internet of the late 1990s worked.


Backbone Provider B provides Internet service to Yahoo, carrying traffic to users around the world. Provider B connects with other companies, such as Backbone Provider A. The residential ISP on the right is a customer of Backbone provider A, and it, in turn, offers Internet access to individual households. The red arrows indicate who pays whom for service.  Because the two backbone providers are roughly the same size, they engage in what's called "settlement-free peering": They exchange traffic with each other with no money changing hands.  A big advantage of this industry structure is that the backbone market is competitive. If Backbone Provider B overcharges Yahoo for connectivity, Yahoo can switch to another backbone provider. I've only drawn two backbone companies, but in the real world there were a number of them competing with one another. The fact that the largest backbone providers engage in settlement-free peering ensures that every computer on the Internet can reach every other computer. Competition among backbone providers helps keep prices down and service quality up.

This industry structure has another virtue, too: Network neutrality is protected by default. Traffic from Yahoo comes to the residential ISP in a big bundle along with traffic from lots of other Web sites. As I argued in a 2008 paper for the Cato Institute, that makes non-discrimination the default and gives residential ISPs limited leverage over distant Web sites. If the residential ISP wanted to discriminate against Yahoo traffic, it would need to make an explicit decision to block or degrade it, which would likely trigger a customer backlash. That has allowed network neutrality to thrive in the 1990s and 2000s even though there was no formal network neutrality regulations until 2010.

But the Internet is changing. One sign of that change is the just-announced deal between Comcast and Netflix. Another is Ars Technica's recent story about a dispute between the backbone provider Cogent and Verizon. Netflix is a Cogent customer. Surging Netflix traffic has been overwhelming the links between Cogent and Verizon. Cogent has asked for those links to be upgraded, but according to Cogent, Verizon has demanded payment for upgrading the links. (When Ars asked Verizon for comment, a spokesman declined to comment on the specifics of the negotiation.)
We can depict the dispute like this:  In this version of the Internet, two big things have changed. First, Netflix is really big. The video streaming site now accounts for about 30 percent of all traffic on the Internet. Second, Verizon acquired the formerly independent backbone provider MCI in 2006, helping to turn itself into a major backbone provider in its own right.  Those changes matter for Cogent's negotiations with Verizon. In the first chart, Backbone Provider A's leverage was limited by the fact that Backbone Provider B could always connect directly to the residential ISP, potentially costing A a customer. That gave A a strong incentive to keep its network fast and its interconnection terms reasonable.  The negotiation between Cogent and Verizon is different. Verizon plays the role of both backbone provider and residential ISP. That puts Verizon in a much stronger negotiating position, because Cogent doesn't have any practical way to route around Verizon. If Cogent wants to reach Verizon's customers, it needs to cut a deal with Verizon.

The FCC's dilemma
The fact that Netflix agreed to pay Comcast suggests that Cogent will likely lose its fight with Verizon as well. And as Cogent's chief executive Dave Schaeffer told Ars, "once you pay it's like blackmail, they've got you, there's nowhere else to go. They'll just keep raising the price in a market where prices [for transit] are falling."  Indeed, in the long run, this development threatens the survival of independent backbone companies like Cogent. If it becomes industry practice for backbone providers to pay residential ISPs, companies like Cogent will become mere resellers of access to the networks of large broadband companies. Or they may be cut out of the loop altogether, as large customers such as Netflix cut deals directly with broadband providers such as Comcast.

Cutting out the middleman might make the Internet more efficient, but it will also make it less competitive. Cogent has many competitors. Verizon's FiOS service does not. If companies like Cogent are squeezed out of business, it will make these already powerful network owners even more powerful.  It would also transform the network neutrality debate. As I mentioned before, the conventional network neutrality debate implicitly assumes that residential ISPs receive Internet traffic from one big pipe. Network neutrality advocates want rules prohibiting ISPs from divvying this pipe up into fast and slow lanes based on business considerations.  But in a world where Netflix and Yahoo connect directly to residential ISPs, every Internet company will have its own separate pipe. And policing whether different pipes are equally good is a much harder problem than requiring that all of the traffic in a single pipe be treated the same. If it wanted to ensure a level playing field, the FCC would be forced to become intimately involved in interconnection disputes, overseeing who Verizon interconnects with, how fast the connections are and how much they can charge to do it.
At this point, the FCC doesn't have any good options. Regulating the terms of interconnection would be a difficult, error-prone process. Trying to reverse the decade-old mergers that allowed America's broadband market to become so concentrated in the first place would be even more so. But the growing power of residential broadband providers will put growing pressure on the FCC to do something to prevent the abuse of that power.

One clear lesson, though, is that further industry consolidation can only make the situation worse. The more concentrated the broadband market becomes, the more leverage broadband providers like Comcast and Verizon will have over backbone providers like Cogent. That gives the FCC a good reason to be skeptical of Comcast's proposed acquisition of its largest rival, Time Warner Cable. Blocking that transaction could save the agency larger headaches in the future.

 

Comcast And Netflix Make A Deal To End Traffic Jam
(By Jennifer Saba, Reuters, 23 February 2014)

Comcast Corp customers are about to get improved streaming service from Netflix after the two companies announced on Sunday an agreement to give Netflix a direct connection to the broadband provider.  This agreement means that Netflix will deliver its movies and TV programs to Comcast's broadband network as opposed through third party providers, giving viewers faster streaming speeds for watching movies and TV programs.  The deal could also mean that other broadband providers like Verizon and AT&T will have to strike a similar arrangements, known in the industry as interconnect agreements.

The companies said in a joint statement that they have been "working collaboratively over many months" to strike a multi-year agreement. The terms were not disclosed and Netflix will not receive preferential network treatment, the companies said.  With more than 44 million subscribers throughout the world, Netflix has been making an effort to connect directly with broadband Internet providers. It has struck similar deals with Cablevision and Cox.  The announcement comes as Comcast prepares to acquire Time Warner Cable for $45 billion, a deal that will draw the scrutiny of U.S. antitrust enforcers.  The combined company would have a near 30 percent share of the U.S. pay television market, as well as be the major provider of broadband Internet access.  At the same time, Federal regulators are wrestling with an issue known as "Net neutrality" concerning broadband providers and whether they can slow down traffic to some particular websites or applications, potentially forcing content providers to pay for faster Web service.  The Federal Communications Commission said last week it plans to rewrite the rules after a U.S. court struck down the commission's previous version.


 

 

 

Friday, December 20, 2013

The Secret Web: Where Drugs, Porn And Murder Live Online

(By Lev Grossman; Jay Newton-Small, Time Magazine, Monday, Nov. 11, 2013)
 
On the afternoon of Oct. 1, 2013, a tall, slender, shaggy-haired man left his house on 15th Avenue in San Francisco. He paid $1,000 a month cash to share it with two housemates who knew him only as a quiet currency trader named Josh Terrey. His real name was Ross Ulbricht. He was 29 and had no police record. Dressed in jeans and a red T-shirt, Ulbricht headed to the Glen Park branch of the public library, where he made his way to the science-fiction section and logged on to his laptop--he was using the free wi-fi. Several FBI agents dressed in plainclothes converged on him, pushed him up against a window, then escorted him from the building.  The FBI believes Ulbricht is a criminal known online as the Dread Pirate Roberts, a reference to the book and movie The Princess Bride. The Dread Pirate Roberts was the owner and administrator of Silk Road, a wildly successful online bazaar where people bought and sold illegal goods--primarily drugs but also fake IDs, fireworks and hacking software. They could do this without getting caught because Silk Road was located in a little-known region of the Internet called the Deep Web.

Technically the Deep Web refers to the collection of all the websites and databases that search engines like Google don't or can't index, which in terms of the sheer volume of information is many times larger than the Web as we know it. But more loosely, the Deep Web is a specific branch of the Internet that's distinguished by that increasingly rare commodity: complete anonymity. Nothing you do on the Deep Web can be associated with your real-world identity, unless you choose it to be. Most people never see it, though the software you need to access it is free and takes less than three minutes to download and install. If there's a part of the grid that can be considered off the grid, it's the Deep Web.
The Deep Web has plenty of valid reasons for existing. It's a vital tool for intelligence agents, law enforcement, political dissidents and anybody who needs or wants to conduct their online affairs in private--which is, increasingly, everybody. According to a survey published in September by the Pew Internet & American Life Project, 86% of Internet users have attempted to delete or conceal their digital history, and 55% have tried to avoid being observed online by specific parties like their employers or the government.

But the Deep Web is also an ideal venue for doing things that are unlawful, especially when it's combined, as in the case of Silk Road, with the anonymous, virtually untraceable electronic currency Bitcoin. "It allows all sorts of criminals who, in bygone eras, had to find open-air drug markets or an alley somewhere to engage in bad activity to do it openly," argues Preet Bharara, U.S. attorney for the Southern District of New York, whose office is bringing a case against Ulbricht and who spoke exclusively to TIME. For 2½ years Silk Road acted as an Amazon-like clearinghouse for illegal goods, providing almost a million customers worldwide with $1.2 billion worth of contraband, according to the 39-page federal complaint against Ulbricht. The Dread Pirate Roberts, the Deep Web's Jeff Bezos, allegedly collected some $80 million in fees.
Most people who use the Deep Web aren't criminals. But some prosecutors and government agencies think that Silk Road was just the thin edge of the wedge and that the Deep Web is a potential nightmare, an electronic haven for thieves, child pornographers, human traffickers, forgers, assassins and peddlers of state secrets and loose nukes. The FBI, the DEA, the ATF and the NSA, to name a few, are spending tens of millions of dollars trying to figure out how to crack it. Which is ironic, since it's the U.S. military that built the Deep Web in the first place.

The story of the Deep Web is a fable of technology and its unintended consequences. In May 1996, three scientists with the U.S. Naval Research Laboratory presented a paper titled "Hiding Routing Information" at a workshop in Cambridge, England. It laid out the technical features of a system whereby users could access the Internet without divulging their identities to any Web servers or routers they might interact with along the way. They called their idea "onion routing" because of the layers of encryption that surround and obscure the data being passed back and forth. By October 2003, the idea was ready to be released onto the Net as an open-source project called Tor (which originally stood for The Onion Router, though the acronym has since been abandoned). If the Deep Web is a masked ball, Tor provides the costumes. It was a highly elegant and effective creation, so much so that even the people who built it didn't know how to break it.
In many ways Tor was less a step forward than a return to an earlier era. For much of the Internet's history, a user's online persona was linked only loosely, if at all, to his or her real-world identity. The Internet was a place where people could create new, more fluid selves, beginning with a handle or pseudonym. Through much of the 1990s, the Web promised people a second life. But over time--and in particular with the arrival of Facebook--our lives online have been tightly tethered to our off-line selves, including our real names. Now everywhere we go, we radiate information about ourselves--our browsing history, our purchases, our taste in videos, our social connections, often even our physical location. Everywhere but the Deep Web.

Why would the U.S. government fund the creation of such a system? Lots of reasons. The police could use it to solicit anonymous tips online, set up sting operations and explore illegal websites without tipping off their owners. Military and intelligence agencies could use it for covert communications. The State Department could train foreign dissidents to use it. Tor is currently administered by a nonprofit organization based in Cambridge, Mass., and sponsored by a diverse array of organizations including Google and the Knight Foundation. But as recently as 2011, 60% of its funding still came from the U.S. government.
The corruption of the Deep Web began not long after it was built. As early as 2006, a website that came to be known as The Farmer's Market was selling everything from marijuana to ketamine. It built up a clientele in 50 states and 34 countries before a DEA-led team brought it down in April 2012. The Deep Web isn't just a source for drugs: there is evidence that jihadists communicate through it and that botnets--massive networks of virus-infected computers employed by spammers--use it to hide from investigators. Even now, it's the work of a minute or two to find weapons or child pornography on the Deep Web. In August, the FBI took down Freedom Hosting, a company specializing in Deep Web sites, alleging that it was "the largest facilitator of child porn on the planet." Its owner, a 28-year-old named Eric Marques, is facing extradition from Ireland.

But Silk Road was different. For one thing, it was more discriminating: its terms of service forbade child pornography, stolen goods and counterfeit currency. For another, it didn't use dollars; it used bitcoins.  When Bitcoin appeared in 2009 it was a radically new kind of currency. It was introduced as a kind of fiscal thought experiment by someone known only as Satoshi Nakamoto, whose true identity is still a mystery. Bitcoin is both a payment system and a currency that is purely digital--it has no physical form. A bitcoin's worth is determined by supply and demand and is valuable only insofar as individuals and companies have agreed to trade it.  Bitcoins belong to an era in which trust in banks and government has been compromised. Users can transfer them from one digital wallet to another without banks brokering the transaction or imposing fees. The currency is completely decentralized--its architecture owes a lot to Napster's successor, BitTorrent--and is based on sophisticated cryptography. Bitcoin is essentially cash for the Internet, virtually anonymous and extremely difficult to counterfeit. The Farmer's Market was vulnerable because it left financial tracks in the real world. Silk Road didn't.
Like Tor, Bitcoin has entirely legitimate reasons for existing. As far as anyone can tell, it's primarily used for legal purposes--scores of businesses accept bitcoins now, including Howard Johnson, the dating website OKCupid and at least one New York City bar. But Bitcoin's digital slipperiness, when force-multiplied by the anonymity of the Deep Web, creates a potential platform for criminal transactions unlike anything the real or virtual world has ever seen. That potential was realized by the Dread Pirate Roberts.

Ross Ulbricht grew up in Texas, an Eagle Scout who went on to study physics at the University of Texas in Dallas. He was a fan of fellow Texan and libertarian Ron Paul; both studied the Austrian school of economics and the work of its father, Ludwig von Mises, who believed in unrestricted markets. Ulbricht earned a master's in materials science and engineering at Pennsylvania State University. Acquaintances describe him as bright and straitlaced. "He wasn't the center of conversation or the center of anything," says a friend who claims to have briefly dated him last year. "He kind of set himself in the background."  By the time he graduated, Ulbricht had become interested in the idea of the Internet as a venue for perfecting free markets. His greatest enemy--according to his LinkedIn profile--was the government. "The most widespread and systemic use of force is amongst institutions and governments, so this is my current point of effort," he wrote. "The best way to change a government is to change the minds of the governed, however. To that end, I am creating an economic simulation to give people a firsthand experience of what it would be like to live in a world without the systemic use of force."
After graduating from Penn State in 2009, Ulbricht went to Sydney, Australia, to visit his sister. It was there, allegedly, that he began working on what would become Silk Road and transforming himself into the Dread Pirate Roberts. By then, drug dealers were already active on the Deep Web, but their businesses tended to fail for two reasons: the money changing hands was traceable, and it was difficult to build trust with clients. Roberts would solve both of those problems. The double layer of anonymity created by Tor and Bitcoin made the money virtually untraceable. To establish trust, Roberts looked to two temples of legitimate commerce for his ideas: Amazon and eBay.  He was a quick study. Users of Silk Road describe a sophisticated, full-featured experience complete with buyer and seller reviews and customer forums. "When deciding whether or not to go with a vendor, I read the feedback on their page and also ratings from a few months ago," says one Silk Road client, who declined to be identified. "I also go to the forums and read the seller's review thread, and depending on the substance, I'll go to an 'avenger's' thread, where people from the Silk Road community post lab results for individual products." When transactions did go south, there was a dispute-resolution system. "Honestly it was like a candy store," says the user.

Products simply arrived by regular mail. "It generally looks like junk mail or information about moving here, or traveling there, or consultation stuff," the user explains. "Usually, when opening the package, you still won't know there are drugs in it unless you're looking for them." Silk Road's community had its own subculture, which skewed toward political outliers. "One memorable thread asked whether we were there for the drugs or the 'revolution,'" recalls the same user. "A lot of people answered 'came for the drugs, stayed for the revolution.'" Dread Pirate Roberts, or simply DPR, was hailed by Silk Road customers as an antiestablishment hero.  Silk Road launched in January 2011. Its existence was hardly kept a secret--with Tor making it possible to get in and out anonymously, why bother? Hiding would just have been bad for business. "It was basically an open thumbing of noses at law enforcement," Bharara says.
The FBI got its first glimpse of Ross Ulbricht that October. Someone named "altoid" had been promoting Silk Road in various chat rooms; then, in a Bitcoin forum, altoid posted an ad seeking an "IT pro in the bitcoin community" for "a venture-backed bitcoin-startup company," according to the complaint against Ulbricht. Ulbricht listed his real e-mail address as the contact for the position.  Ulbricht had left more clues for the feds. His Google+ account linked to some of the same sites and videos--including some from the Ludwig von Mises Institute--that the Dread Pirate Roberts mentioned. The FBI obtained records from Google that showed Ulbricht was accessing his Gmail account from San Francisco; the server through which Roberts accessed Silk Road showed an IP address corresponding to a San Francisco café. Ulbricht also posted a request for help with some computer code on a website for programmers, again under his own name. He hastily changed his user ID (to "frosty"), but the damage was done: that same code later turned up as part of the Silk Road site.

From there the thread becomes darker and more tangled. In January 2013, a Silk Road employee apparently stole bitcoins from users, then managed to get arrested on another charge. Roberts, displaying a side investigators hadn't seen before, allegedly contracted with a Silk Road customer to have the employee tortured until he or she returned the bitcoins, then killed. This was the work not of a libertarian idealist but of a sociopath. Roberts was unaware that the hit man he was dealing with was an undercover FBI agent who had bought drugs on Silk Road as part of a sting operation. The agent sent Roberts faked photographic proof of the murder. Satisfied, Roberts wired $80,000 from an Australian money-transfer exchange.
According to the testimony of FBI agent Christopher Tarbell, who led the investigation, a Silk Road user in Canada began to blackmail Roberts, threatening to leak information about the site's clientele. Roberts responded by paying someone known online as "redandwhite" the sum of $150,000 in bitcoins to kill the blackmailer. (Roberts received photos of that killing too, but the Canadian police can't match it to any murder they're aware of.) In June 2013, Roberts ordered a set of fake IDs from redandwhite. Later that month, U.S. Customs opened a package from Canada containing nine fake IDs bearing Ulbricht's photo and birth date. The package also gave them Ulbricht's address.

The net was closing fast. By July, FBI hackers had tracked down one of Silk Road's servers, in a foreign country whose name has not yet been revealed, which gave them copies of all Roberts' e-mail plus transaction records dating to the site's launch. On July 26, agents from Homeland Security knocked on Ulbricht's door. He admitted that he'd been living under a false name.  The authorities got another break on July 31, when they raided the condo of a Seattle-area dealer who sold meth, coke and heroin through Silk Road under the handle Nod; they quickly flipped him as an informant. On Oct. 1, two years after they first spotted him, federal agents followed Ulbricht to the Glen Park library and arrested him. The FBI says it caught him red-handed with evidence on his laptop screen.
Many in Washington are troubled by the fact that it took so much time and effort just to close one illegal website run by a would-be Walter White.  The FBI is policing an ever evolving Internet using static, often outdated laws. The Communications Assistance for Law Enforcement Act, which governs law enforcement's warrant process and is known as CALEA, was passed in 1994. "We're coming up next year on its 20th anniversary," says Marcus Thomas, former assistant director of the FBI's technology division, who now advises Subsentio, a firm that helps companies comply with CALEA. "It's in serious need of being updated to keep pace with the current environment."  Even leaving aside specialized tools like Tor, there are plenty of mainstream technologies that criminals can use to hide their activities: satellite phones, PIN messaging on BlackBerrys and even Apple iMessage, the instant-messaging service on iPhones and iPads. "The DEA got burned in April when it came out that we weren't able to capture iMessage on a wiretap," says Diana Summers Dolliver, a professor at the University of Alabama's department of criminal justice who previously worked at the Drug Enforcement Administration. "So of course all the bad guys went out and got iPhones and encrypted iMessage."

The FBI isn't trying to listen in on everything the way the NSA allegedly does; it's just looking to obtain legal search warrants under CALEA. But even that isn't as simple as it sounds. "First of all, even if you have an idea that they're using their computer to ill ends, you can't seize the computer for evidence," Dolliver says. "You have to have probable cause. So that's roadblock No. 1. Then, once you get ahold of their computer, it takes a lot of forensic work to figure out who the perps are." There are also many companies that have built their businesses specifically on providing their users with privacy and anonymity. Interest groups like the Center for Democracy and Technology argue that making new technologies CALEA-compliant stifles innovation and that building in back doors for law enforcement can make otherwise secure systems vulnerable to hackers.
For years the FBI has been working with other agencies on a proposal to update CALEA, which they finally submitted to the White House in April. The FBI won't comment on details, but generally speaking, the idea is not to force companies to divulge information, potentially compromising them technologically, but to increase fines on those that choose not to comply. If the arguments are reasonable, the timing is terrible: the Edward Snowden leaks began on June 5 and, almost at once, the idea of making electronic surveillance by the government easier became politically radioactive.

In 2012 the FBI established--jointly with the DEA, the ATF and the U.S. Marshals Service--the National Domestic Communications Assistance Center (NDCAC) in Quantico, Va. The center exists because--to quote from the appropriations bill that funds it--"changes in the volume and complexity of today's communications services and technologies present new and emerging challenges to law enforcement's ability to access, intercept, collect, and process wire or electronic communications to which they are lawfully authorized." In essence, the NDCAC is a tech startup with at least $54 million in funding for the 2013 fiscal year that's focused on helping law enforcement penetrate areas of the Web that are currently unsearchable.
The FBI isn't the only agency that's worried about the Deep Web. The Senate Finance Committee is looking at beefing up the IRS' funding for dealing with virtual currencies and investigating potential tax shelters, Senate sources say. Bitcoin presents Washington with a whole set of regulatory challenges all on its own. Is Bitcoin a currency? (Under certain definitions, no, because it isn't legal tender issued by a country.) Is it a commodity? Should bitcoin traders be regulated as banks or wire services?

The incarceration of Ross Ulbricht started a spreading wave of arrests of suspected Deep Web dealers. On Oct. 8, police in Sweden arrested two men on charges of selling pot through Silk Road, and four more men were picked up in the U.K. the same day on drug charges. "These arrests send a clear message to criminals," said Keith Bristow, head of Britain's National Crime Agency. "The hidden Internet isn't hidden, and your anonymous activity isn't anonymous. We know where you are, what you are doing, and we will catch you."  It's not completely clear that that's true. One of the documents leaked by Snowden was an NSA presentation dated June 2012 titled "Tor Stinks." It described the difficulties the NSA has been having cracking Tor, and it said definitively, "we will never be able to de-anonymize all Tor users all the time." The Deep Web template that Ulbricht created remains technically sound. As one former Silk Road user puts it, "The dust has settled and everyone is kind of like 'Oh, well, time to order some more drugs.' We all knew it was coming." There are forum posts discussing the possibility of a reconstituted Silk Road, based on a backed-up version of the old site but with added security, that could launch on Nov. 5. "This will be where the action is once it's up and running," says the user.
Tor itself is left in the curious position of being funded by some parts of the federal government (including the State Department and the Department of Defense) while others (the FBI and the NSA) are trying to crack it. But even law-enforcement officials directly involved with the case hasten to clarify that they don't blame the technology itself for Silk Road. "There's nothing inherently wrong with anonymity on the Internet," U.S. Attorney Bharara says. "There's nothing inherently wrong with certain kinds of currency, like bitcoins. Just like there's nothing inherently wrong with cash. But it happens to be the case that ... it's also the thing that allows the drug trade to flourish. It allows money laundering to happen. It allows murder for hire to happen."

What's certain is that the need for Tor--or something like it--isn't going away. The Internet is becoming an increasingly unprivate place, where multibillion-dollar business plans are being built on companies' ability to observe and rapaciously harvest every last iota and fillip of consumer behavior. More and more, it falls to consumers themselves to say where the line is and to take control of their personal information.  What makes the Internet, and particularly the Deep Web, so hard to pin down is that it cuts across so many spheres that used to be strictly separate. It's private and public, personal and professional and political, all at the same time; it has a peculiar way of compressing all the formerly disparate threads of our lives into one single pipeline leading directly into our studies and bedrooms. It's virtually impossible for the law to tease those strands apart again. Right now we're trapped unpleasantly between two ideals, the blissful anonymity of the Net as it was first conceived and the well-regulated panopticon it is becoming. It's the worst of both worlds: the Deep Web provides too much privacy and the rest of the Web not enough.
Ulbricht himself currently has plenty of privacy. He's spending 20 hours a day alone in a cell in an Alameda County jail near Oakland, Calif. On Oct. 16 he hired a New York lawyer named Joshua Dratel, who has some experience with controversial cases. His past clients include several alleged terrorists. "He'll be pleading not guilty whenever he's arraigned on charges," Dratel told TIME. "He denies the charges right now, and he'll continue to deny [them]," he said. Perhaps inevitably, 20th Century Fox has already optioned the story of Silk Road from Wired magazine for a feature film.

Meanwhile, Ulbricht fills his days writing letters to friends and family and reading Patrick O'Brian's Master and Commander. He has no Internet access. He may, however, still have some of his pirate's treasure. On Oct. 25, Bharara announced that, after a prolonged hacking campaign, investigators had gained access to a cache of 122,000 of the Dread Pirate Roberts' bitcoins, worth over $24.9 million. But there may be many more millions out there. People may always be fallible and venal, but technology, at least for the time being, can still keep some of our secrets.