digital information

The partnership between the intelligence community and Palantir Technologies, a Palo Alto, Calif., company founded by a group of inventors from PayPal, is just one of many that the National Security Agency and other agencies have forged as they have rushed to unlock the secrets of “Big Data.”

Today, a revolution in software technology that allows for the highly automated and instantaneous analysis of enormous volumes of digital information has transformed the N.S.A., turning it into the virtual landlord of the digital assets of Americans and foreigners alike. The new technology has, for the first time, given America’s spies the ability to track the activities and movements of people almost anywhere in the world without actually watching them or listening to their conversations.

New disclosures that the N.S.A. has secretly acquired the phone records of millions of Americans and access to e-mails, videos and other data of foreigners from nine United States Internet companies have provided a rare glimpse into the growing reach of the nation’s largest spy agency. They have also alarmed the government: on Saturday night, Shawn Turner, a spokesman for the director of national intelligence, said that “a crimes report has been filed by the N.S.A.”

With little public debate, the N.S.A. has been undergoing rapid expansion in order to exploit the mountains of new data being created each day. The government has poured billions of dollars into the agency over the last decade, building a one-million-square-foot fortress in the mountains of Utah, apparently to store huge volumes of personal data indefinitely. It created intercept stations across the country, according to former industry and intelligence officials, and helped build one of the world’s fastest computers to crack the codes that protect information.

While once the flow of data across the Internet appeared too overwhelming for N.S.A. to keep up with, the recent revelations suggest that the agency’s capabilities are now far greater than most outsiders believed. “Five years ago, I would have said they don’t have the capability to monitor a significant amount of Internet traffic,” said Herbert S. Lin, an expert in computer science and telecommunications at the National Research Council. Now, he said, it appears “that they are getting close to that goal.”

On Saturday, it became clear how close: Another N.S.A. document, again cited by The Guardian, showed a “global heat map” that appeared to represent how much data the N.S.A. sweeps up around the world. It showed that in March 2013 there were 97 billion pieces of data collected from networks worldwide; about 14 percent of it was in Iran, much was from Pakistan and about 3 percent came from inside the United States, though some of that might have been foreign data traffic routed through American-based servers.

A Shift in Focus

The agency’s ability to efficiently mine metadata, data about who is calling or e-mailing, has made wiretapping and eavesdropping on communications far less vital, according to data experts. That access to data from companies that Americans depend on daily raises troubling questions about privacy and civil liberties that officials in Washington, insistent on near-total secrecy, have yet to address.

“American laws and American policy view the content of communications as the most private and the most valuable, but that is backwards today,” said Marc Rotenberg, the executive director of the Electronic Privacy Information Center, a Washington group. “The information associated with communications today is often more significant than the communications itself, and the people who do the data mining know that.”

In the 1960s, when the N.S.A. successfully intercepted the primitive car phones used by Soviet leaders driving around Moscow in their Zil limousines, there was no chance the agency would accidentally pick up Americans. Today, if it is scanning for a foreign politician’s Gmail account or hunting for the cellphone number of someone suspected of being a terrorist, the possibilities for what N.S.A. calls “incidental” collection of Americans are far greater.

United States laws restrict wiretapping and eavesdropping on the actual content of the communications of American citizens but offer very little protection to the digital data thrown off by the telephone when a call is made. And they offer virtually no protection to other forms of non-telephone-related data like credit card transactions.

Because of smartphones, tablets, social media sites, e-mail and other forms of digital communications, the world creates 2.5 quintillion bytes of new data daily, according to I.B.M.

Reporting was contributed by David E. Sanger and Scott Shane from Washington, Steve Lohr and James Glanz from New York, and Quentin Hardy from Berkeley, Calif.

Article source: http://www.nytimes.com/2013/06/09/us/revelations-give-look-at-spy-agencys-wider-reach.html?partner=rss&emc=rss

PARIS — A second French publisher has reached a deal on digital books with Google to settle a copyright lawsuit in exchange for control over how its out-of-print, copyright-protected works are scanned and sold.

Such works account for the vast majority of the world’s books, and they are central to Google’s ambitions of creating a universal digital information repository. But its digitization project has prompted numerous lawsuits by publishers seeking to enforce their copyrights.

On Thursday, the French publisher La Martinière said that it had agreed to split revenue from digital sales of these books with Google. The accord comes after a similar agreement between Google and Hachette Livre, the largest French publisher.

In 2009, La Martinière won a ruling against Google in a Paris court that awarded the publisher 300,000 euros ($420,000), and ordered Google to stop scanning its books. Google appealed that decision, but the two companies said Thursday that they had agreed to end the litigation.

Philippe Colombet, director of Google Books in France, said that the deal would allow the company to move forward “in a constructive fashion, to the benefit of French authors and readers.”

“This collaboration is an important step in our relations with French publishers and contributes to the preservation and the flourishing of French culture,” he said in a statement.

The settlement comes as Google struggles to reach an agreement with United States publishers and authors on out-of-print, copyright-protected works. Last winter, the judge overseeing the case, Denny Chin, rejected a settlement proposal that had already been revised, and talks have bogged down since then.

Like the Hachette deal, the agreement with La Martinière is different from the proposed settlement in the United States that Judge Chin rejected in at least one important way: it lets the publisher choose which works can be scanned or sold. Under the American proposal, Google was free to digitize and sell any works unless the copyright holders opted out.

“This agreement is very important, it seems to me, because it reaffirms respect for authors and, more broadly, for intellectual property,” said Hervé de la Martinière, president of the publishing house. Google had said it hoped that the Hachette deal would be a model for other agreements with European publishers. But it still faces a lawsuit by three French publishers, Albin Michel, Flammarion and Gallimard, that say that Google scanned thousands of their works without permission.

Article source: http://feeds.nytimes.com/click.phdo?i=c4905fceb59aea548ff374ea80975d39

Revelations Give Look at Spy Agency’s Wider Reach

Google Reaches Deal With 2nd French Publisher

Recent News

Partners