Big Data
Larger datasets allow better predictive analytics: Big Data is a lot more than business buzz; http://eicker.at/BigData
Tagged: Processes Toggle Comment Threads | Keyboard Shortcuts
Gerrit Eicker
Journalism 2012
What will 2012 bring for journalism? Social media bubble burst? Tech criticism? Appification? http://eicker.at/Journalism2012
-
Gerrit Eicker
NJL: “Predictions for Journalism 2012 – To close out 2011, we asked some of the smartest people we know to predict what 2012 will bring for the future of journalism.”
NJL, Carrie Brown-Smith: “The social media bubble may burst, and more predictions for 2012 – In 2012 we will see a growing gap between newsrooms that are innovating and those that are…not. – 2011 saw a number of promising examples news organizations going beyond ‘digital first’ platitudes to actually trying things and making it work, and I’m optimistic we will see this trend continue. … 2012 will be a good year for local television. … 2012 *might* see a bursting of the social media bubble, or at least convince us that it is harder game to play than we thought. – This might seem odd coming from an avid social media user who developed two new courses on it for our journalism department and who even has been christened with that dreaded ‘social media guru’ title on more than one occasion [ack]. And assuredly, I do think social media is an incredibly important tool for news organizations to use to promote their content, improve their reporting, and engage their audiences… Journalism schools will increasingly step up to the plate to play a leadership role in journalism innovation in 2012.”
NJL, Dave Winer: “We need to improve tech criticism. Here’s how. – At the end of this year I’m thinking about the need for proper criticism of software, alongside other arts like theater, movies, music, books, travel, food and architecture. It’s finally time to stop being all gee whiz about this stuff. Tech is woven into the fabric of our culture, as much as or more so than the other arts. And it’s headed toward being even more interwoven. – We all need this, on all sides of the art. As users and creators. … The goal would be to move away from the lone inventor myth and see tech projects as more like film production or a even more apt, a TV series. Software is a process.”
NJL, Nicholas Carr: “2012 will bring the appification of media – For years now, the line between the software business and the media business has been blurring. Software applications used to take the form of packaged goods, sold through retail outlets at set prices. Today, as a result of cloud computing and other advances, applications look more and more like media products. … As traditional media companies have moved to distribute their wares in digital form – as code, in other words – they’ve come to resemble software companies. … The old general-purpose web, where everyone visited the same sites and saw the same stuff, is rapidly being supplanted by specialized packages of digital content geared to particular devices – iPhone, iPad, Android, BlackBerry, Kindle, Nook, Xbox – or to particular members-only sites like Facebook and Google+. … Apps are as much content-delivery services as they are conventional software programs. Newspapers, magazines, books, games, music albums, TV shows: All are being reimagined as apps. Appified, if you will. – Appification promises to be the major force reshaping media in general and news media in particular during 2012. … Appification opens to newspapers the powerful marketing and pricing strategy that the Berkeley economist (and now Google executive) Hal Varian dubs ‘versioning.’ Long a cornerstone of the software business, versioning is the practice of creating many versions of the same underlying informational product, packaging them in different ways, and selling them at different prices to different sets of customers. … We already see versioning strategies at work in the ‘metered’ programs operated by a growing number of papers… The orthodox view among online pundits has been that paywalls and subscription fees won’t work for general-interest newspapers, that people simply won’t pay for a bundle of news online. … That won’t mean the end of the industry’s struggles, but it does portend a brighter future. And that’s good news.“
-
Gerrit Eicker
NJL, Robert Hernandez: “For journalism’s future, the killer app is credibility – We know that Content is King. There is no doubting this concept. If you don’t have ‘it,’ no one is going to engage with you. We know that Distribution is Queen. In this modern age, what’s the point of having ‘it’ if no one will find it? My prediction is that this ruling monarchy will be augmented by… a prince. Perhaps a duke? Whatever. And it’s called Credibility. … We want to trust journalism. And to do so, we need to trust journalists. – And bypassing the blogger-vs-tweeter-vs-media company-vs-journalist debate, it is going to come down to one thing: Credibility. – Can I reliably trust you to tell me what is going on? If the answer is yes, then I don’t care if you work out of a newsroom or out of your garage.”
NJL, Dan Gillmor: “2012 will be the year of the content-controller oligopoly – Journalists will start paying serious attention to an issue that will ultimately determine whether they can participate in the digital world: control. – We are moving rapidly from an era of an oligopoly of content providers to an oligopoly of content controllers: new choke points. … This consolidation, to a very few companies plus increasing government intervention, is even more dangerous – and information providers of all kinds are finally starting to grasp what’s happening. … Search engines… wire-line Internet service providers… mobile carriers… Apple… the copyright cartel… government: The forces of control are getting more powerful every day. They are a direct threat to journalism and innovation. Journalists are starting to take note – and we can only hope it’s not too late.”
NJL, Martin Langeveld: “A look back at my 2011 predictions, along with a fresh batch for 2012 – The Eurozone crisis gives way to the dollarzone crisis as Congress continues to deadlock over budget and debt issues. The Dow falters, dropping 10% by mid-year. The prospect of a President Gingrich lifts hopes briefly, but when Obama is re-elected while Republicans retain the House and retake the Senate, it sinks another 5%. Newspaper stocks fail to beat the market, but all the digital giants (Google, Yahoo, Microsoft, Amazon, AOL and Apple) are all in positive territory well ahead of the Dow.“
-
Gerrit Eicker
NJL, Amy Webb: “Big data, mobile payments, and identity authentication will be big in 2012 – When Google launched its new social network Plus, it made headlines for requiring users to create accounts with their real names and identities. At the time, Google argued that people behave better when they use their real names – it even went so far as to call Plus not a social network, but a digital identity service. Some are now questioning how and when Google would be using our digital identities. Outside of social media, police departments in the U.S. have started using MORIS, which snaps on to an iPhone and enables officers to scan the irises of alleged criminals. In Brazil, police offers are starting to fit glasses with biometric cameras which can scan 46,000 data points on a face and query a criminal database in real-time. Siri, an application acquired by Apple for the iPhone, can recognize individual voices and infer contextual information based on the user. In 2012, our fingerprints may not matter nearly as much as our eyes, faces, and usernames.”
NJL, Gina Masullo Chen: “Next year, personalization platforms will bring us more choices, not fewer – News has always been about making choices among lots of information; technology just helps us make those choices more smartly. … If I were creating this future, a large component of it would include offering greater customization of news and information for readers. … People choose what they like, what interests them, what gratifies their own needs, and what fits how they see the world. – In 2012, technology may help them make those choices more quickly and easily.”
NJL, Tim Carmody: “Next year, Kindles, iPhones, and tablets will truly grow up – In consumer technology, five year cycles are really interesting. … Why does this matter for 2012? Well, besides five years of iPhone, we’re also looking at five years of Kindle. That’s two five-year anniversaries that really signal the point when mobile reading became mainstream. You could also call it the five-year anniversary of the tablet as a media device, because really, that’s what the Kindle is, form factor-wise. … With e-readers, in general, I don’t think we’ve really figured out how touchscreen reading devices are supposed to work, how to blend what we’ve learned from tablets with what we’ve learned from e-readers. … If I could make an analogy, 2011 for reading devices was like the first color/video iPod. 2012 will be the iPhone year. It seems like we made big leaps forward only because we don’t actually know what the real leap forward looks like yet.”
NJL, Burt Herman: “In the coming year, social media journalists will #Occupythenews – Social media’s essential role in serious journalism can no longer be ignored. Next year, social media journalism will finally grow up. – Journalism will be more collaborative, embracing the fundamental social nature of the Internet. The story will be shaped by people involved in the news, curated by savvy editors from diverse sources and circulated back again to the audience. This is the new real-time news cycle. … Journalists have always taken masses of information and condensed it into something digestible for readers, adding context and insights. More than ever, journalists will curate sources outside their newsrooms to tell their stories. … It’s up to the new generation of social media journalists to #Occupythenews – and to make sure society doesn’t miss the stories that, diffuse and elusive though they may be, are crucial to understanding our world.”
NJL, Rex Sorgatz: “LA is the future (kill me now) – Let’s get this out of the way: I hate LA. – I hate LA the way that any good New Yorker hates LA, with a passion bordering on paranoid psychosis. I hate the faux culture, I hate the vapid people, I hate the unctuous politics. … But I am here to preach a new sermon: LA is the Future. It pains me to say, but it’s time we all sucked up the fresh sludge spewing from the organic juice pumper. … Let’s start here: Right now, I pay over $200 per month to have 1,600 TV channels pumped into my apartment. How many of those channels do I watch? A dozen, max. – This is clearly broken. Really broken. Stupid broken. – And we all know this has to end, somehow. And we all know it will end, somehow. … But I think we can all agree that this broken system is going to be fixed, somehow. – And when that happens, the fallout for the LA-based television industry will be catastrophic. … When the collapse hits, capital will rush out of the traditional entertainment industry faster than you can say ‘Lehman Brothers.’ … It will be fun, it will be exciting. And I might even hate LA a little less.”
NJL, Vadim Lavrusik: “Curation and amplification will become much more sophisticated in 2012 – A big question for the coming year: How will the right communities get the right kind of news? – Ladies and gentlemen, we can rebuild it. We have the technology. We have the capability to build a sustainable journalism model. Better than it was before. Better, stronger, faster. … For the last year, much of the focus has been on curating content from the social web and effectively contextualizing disparate pieces of information to form singular stories. … Because anyone can publish content today and report information from a breaking news event, the role journalists can play in amplifying – and verifying – that content becomes ever more important. … Curation itself will continue to evolve and become more sophisticated. … The coming year will see a more balanced approach. … Information will, in this environment, inevitably reach the citizenry; at stake is the quality of the information that does the reaching. If content is king, distribution is queen.”
NJL, Steve Buttry: “From a dropped paywall to a social media Pulitzer, expect a year of transformation – We will see more newspaper-company transactions in 2012. … [P]eople with sufficient wealth appear to have bought the companies outright, taking on little or no debt. … The winner of the 2012 presidential election will work harder on reaching voters through social media than through the professional media. …Digital First Media will continue to lead the way in transforming the digital news business. … We will see some major realignment of journalism and news-industry organizations.”
NJL, Paul Bradshaw: “Collaboration! Data! 2012 will see news outlets turning talk into action – 1. 2012 will be the year we finally move away from the traditional homepage – The ‘stream’ as an interface will move from being the preserve of social media platforms like Facebook and Twitter to being a serious consideration for news website homepages. We’re all 24-hour news channels now. 2. In 2012, ‘Collaboration Is King’… 3. News organizations turn talk into action on data – Any news organization that is serious about its fourth estate role is building the skills to interrogate those datasets.”
NJL, Dan Kennedy: “2012 will bring ‘the great retrenchment’ among newspaper publishers – Paywalls may become more popular in 2012; that doesn’t mean they’ll be enough to save a flailing industry. … The great newspaper retrenchment may prove to be more than a dead-cat bounce. As the economy slowly improves, the newspaper business may well enjoy a semi-revival. But before long, the forces that have been undermining newspapers since the rise of the commercial web in the mid-1990s will come back to the fore. … For the most part, though, you can be reasonably sure that newspaper companies will continue to cut costs, maximize profits (or minimize losses), and do their best ostrich imitations until they find themselves under siege once again. – They’re standing up for traditional values – and what could be more traditional than failing to plan for the future?”
NJL, Emily Bell: “2012 will be a year of expanded ‘network sensibility’ – Making predictions about journalism is a hopeless business: Jay Rosen, who is much wiser than I am, said he never does it, and I salute him for that. … The network sensibility will grow in newsrooms that currently don’t tend to have it as part of their process – it is still seen in the vast majority of places as more of a ‘nice to have’ rather than a ‘must have.’ … While this use of distributed tools and new platforms continues at speed, I think we will also see some much-needed closer scrutiny on what this new reality means for journalism and its constant redefinition of products and services. … Journalists have always been very skilled at stories and projects and fairly awful at thinking about platforms. We need more engineers who want to be journalists, and we need to teach students more about the implications of publishing in a digital environment – whatever the format their journalism originally takes.”
NJL: “Amazon conquers, Patch dies, a Facebook-only outlet is born…and more predictions for 2012 – [P]redictions about the business of, and platforms for, journalism, from and platforms for, journalism, from Brian Boyer, Rick Edmonds, Kevin Kelly, Joy Mayer, Alan Murray, Alan Mutter, Geneva Overholser, Howard Owens, and Sree Sreenivasan.”
Gerrit Eicker
Google Search
Google: Another look under the hood of search – the evolution of Google Search; http://eicker.at/GoogleSearch
-
Gerrit Eicker
Google: “Over the past few years, we’ve released a series of blog posts to share the methodology and process behind our search ranking, evaluation and algorithmic changes. Just last month, Ben Gomes, Matt Cutts and I participated in a Churchill Club event where we discussed how search works and where we believe it’s headed in the future. – Beyond our talk and various blog posts, we wanted to give people an even deeper look inside search, so we put together a short video that gives you a sense of the work that goes into the changes and improvements we make to Google almost every day. While an improvement to the algorithm may start with a creative idea, it always goes through a process of rigorous scientific testing. Simply put: if the data from our experiments doesn’t show that we’re helping users, we won’t launch the change. … In the world of search, we’re always striving to deliver the answers you’re looking for. After all, we know you have a choice of a search engine every time you open a browser. As the Internet becomes bigger, richer and more interactive it means that we have to work that much harder to ensure we’re unearthing and displaying the best results for you.”
Google: “Following up on our video on how we make improvements to search, we wanted to share with you a short history of the evolution of search, highlighting some of the most important milestones from the past decade-and a taste of what’s coming next. – Our goal is to get you to the answer you’re looking for faster and faster, creating a nearly seamless connection between your questions and the information you seek. For those of you looking to deepen your understanding of how search has evolved, this video highlights some important trends like universal results, quick answers and the future of search. – For more information, go to Google.com/insidesearch”
SEL: “Google released a short video today highlighting some of its key milestones in search over the past decade. It’s both a fun blast from the past and a worthwhile reminder of how much things have changed over the years. The video is also a nice follow-on to the look under the hood of search that Google released in August.”
TC: “One anecdote centers on the attacks of September 11: in the wake of the attacks, many people were searching for ‘New York Twin Towers’ and related queries as they attempted to get the latest news – only to find that Google’s index didn’t have any relevant news stories because it was weeks old (Danny Sullivan has written more about this failure). Google’s quick-fix was to post links to relevant news articles on its homepage, and its stumble eventually led to the launch of Google News.”
ATD: “So, what would be a hard query that Google wants to answer in the future? Complex questions that take reasoning, says Google Fellow Amit Singhal. ‘In my ideal world, I would be able to walk up to a computer and say, ‘Hey, what is the best time for me to sow seeds in India, given that monsoon was early this year?’‘ Singhal says in the video.”
RWW: “4 Big Trends in the Evolution of Google Search … Univeral Search – Google’s introduction of universal search in 2007 was the beginning of a trend away from separating Web search results by type and toward putting it all in one place. … Google Goes Mobile and Local – Before long, Google was deep into the business of local commerce. With the rise of Android, Google had an end-to-end business of finding location-based results for local businesses, restaurants and destinations. … Google Search and Time – Google has changed the impact of time on search, as well as place. It has tweaked the way timeliness of content appears in search multiple times, and its latest update calculates when a search is probably looking for recent results rather than historical ones. … Google+: Google’s New Identity – Identity is the final piece of the puzzle. Google has personalized results for a while using Web history and sharing data. But with the launch of Google+, Google has introduced a form of social SEO. Social activity is now a fundamental part of how search results appear for users logged into Google’s ubiquitous Web services.“
Gerrit Eicker
Wikipedia Citations
Does only written knowledge count? Wikipedia and the rules of citation and verification; http://eicker.at/WikipediaCitations
Gerrit Eicker
Gamification
Meaningful Play, getting gamification right with: meaning, mastery, autonomy; http://eicker.at/Gamification @dingstweets
Gerrit Eicker
If This Then That
ifttt, short for: if this then that, makes the Internet programmable, triggers actions to channels; http://eicker.at/ifttt
Gerrit Eicker
IT Transparency and Business Value
Gartner: IT organisations face disruptive change in 2011 due to transparency, need to drive business value; http://eicker.at/1v
Gerrit Eicker
Digital Distraction vs. Utilisation
Growing up digital, wired for distraction; http://eicker.at/1m vs. open ideas about utilizing technology; http://eicker.at/1n
Gerrit Eicker
Agil?!
Herwarth von Bittenfeld: Die agile Revolution. Was bringt die Umstellung von klassisch auf agil? http://j.mp/cp5no8
-
Gerrit Eicker
Herwarth von Bittenfeld: “Was bringt die Umstellung von einem klassischen Wasserfallmodell in der Softwareentwicklung auf agile Prinzipien? Sie kann bei konsequenter Durchführung geradezu einer Revolution gleichen, wie ich mit zwei Fallbeispielen zeigen möchte.”
Wasserfallmodell: “Das Wasserfallmodell ist ein lineares (nicht-iteratives) Vorgehensmodell in der Softwareentwicklung, bei dem der Softwareentwicklungsprozess in Phasen organisiert wird. Dabei gehen die Phasenergebnisse wie bei einem Wasserfall immer als bindende Vorgaben für die nächst tiefere Phase ein. – Im Wasserfallmodell hat jede Phase vordefinierte Start- und Endpunkte mit eindeutig definierten Ergebnissen. In Meilensteinsitzungen am jeweiligen Phasenende werden die Ergebnisdokumente verabschiedet. Zu den wichtigsten Dokumenten zählen dabei das Lastenheft sowie das Pflichtenheft. In der betrieblichen Praxis gibt es viele Varianten des reinen Modells. Es ist aber das traditionell am weitesten verbreitete Vorgehensmodell. – Der Name ‘Wasserfall’ kommt von der häufig gewählten grafischen Darstellung der fünf bis sechs als Kaskade angeordneten Phasen.”
Agile Softwareentwicklung: “Agile Softwareentwicklung ist der Oberbegriff für den Einsatz von Agilität (lat. agilis ‚flink, beweglich‘) in der Softwareentwicklung. Je nach Kontext bezieht sich der Begriff auf Teilbereiche der Softwareentwicklung – wie im Fall von Agile Modeling – oder auf den gesamten Softwareentwicklungsprozess – exemplarisch sei Extreme Programming angeführt. Agile Softwareentwicklung versucht mit geringem bürokratischen Aufwand und wenigen Regeln auszukommen. – Das Ziel Agiler Softwareentwicklung ist es, den Softwareentwicklungsprozess flexibler und schlanker zu machen, als das bei den klassischen Vorgehensmodellen der Fall ist. Man möchte sich mehr auf die zu erreichenden Ziele fokussieren und auf technische und soziale Probleme bei der Softwareentwicklung eingehen. Die Agile Softwareentwicklung ist eine Gegenbewegung zu den oft als schwergewichtig und bürokratisch angesehenen traditionellen Softwareentwicklungsprozessen wie dem Rational Unified Process oder dem V-Modell.“
Gerrit Eicker
Link Building KPIs
Bencken: Tracking KPIs for link building is a critical step. 6 metrics you need to manage; http://j.mp/9At5tG
Gerrit Eicker 15:12 on 13. January 2012 Permalink |
Wikipedia: “In information technology, big data consists of datasets that grow so large that they become awkward to work with using on-hand database management tools. Difficulties include capture, storage, search, sharing, analytics, and visualizing. This trend continues because of the benefits of working with larger and larger datasets allowing analysts to ‘spot business trends, prevent diseases, combat crime.’ Though a moving target, current limits are on the order of terabytes, exabytes andzettabytes of data. Scientists regularly encounter this problem in meteorology, genomics, connectomics, complex physics simulations, biological and environmental research, Internet search, finance and business informatics. Data sets also grow in size because they are increasingly being gathered by ubiquitous information-sensing mobile devices, aerial sensory technologies (remote sensing), software logs, cameras, microphones, Radio-frequency identification readers, wireless sensor networks and so on. Every day, 2.5 quintillion bytes of data are created and 90% of the data in the world today was created within the past two years.”
ATD: “Over the last several years, there has been a massive surge of interest in Big Data Analytics and the groundbreaking opportunities it provides for enterprise information management and decision making. Big Data Analytics is no longer a specialized solution for cutting-edge technology companies – it is evolving into a viable, cost-effective way to store and analyze large volumes of data across many industries. … Big Data technologies like Apache Hadoop provide a framework for large-scale, distributed data storage and processing across clusters of hundreds or even thousands of networked computers. The overall goal is to provide a scalable solution for vast quantities of data … while maintaining reasonable processing times. … The barriers to entry for Big Data analytics are rapidly shrinking. Big Data cloud services like Amazon Elastic MapReduce and Microsoft’s Hadoop distribution for Windows Azure allow companies to spin up Big Data projects without upfront infrastructure costs and allow them to respond quickly to scale-out requirements. … To apply this new technology effectively, it is important to understand its role and when and how to integrate Big Data with the other components of the data warehouse environment. … Hadoop provides an adaptable and robust solution for storing large data volumes and aggregating and applying business rules for on-the-fly analysis that crosses boundaries of traditional ETL and ad-hoc analysis. It is also common for the results of Big Data processing jobs to be automated and loaded into the data warehouse for further transformation, integration and analysis. … Big Data adoption will continue to be driven by large and/or rapidly growing data being captured by automated and digitized business processes. … As we move into the age of Big Data, companies that are able to put this technology to work for them are likely to find significant revenue generating and cost savings opportunities that will differentiate them from their competitors and drive success well into the next decade.”
ORR: “Big data is data that exceeds the processing capacity of conventional database systems. The data is too big, moves too fast, or doesn’t fit the strictures of your database architectures. To gain value from this data, you must choose an alternative way to process it. .. The hot IT buzzword of 2012, big data has become viable as cost-effective approaches have emerged to tame the volume, velocity and variability of massive data. … The value of big data to an organization falls into two categories: analytical use, and enabling new products. … The emergence of big data into the enterprise brings with it a necessary counterpart: agility. Successfully exploiting the value in big data requires experimentation and exploration. Whether creating new products or looking for ways to gain competitive advantage, the job calls for curiosity and an entrepreneurial outlook. … If you could run that forecast taking into account 300 factors rather than 6, could you predict demand better? – This volume presents the most immediate challenge to conventional IT structures. … The importance of data’s velocity – the increasing rate at which data flows into an organization – has followed a similar pattern to that of volume. … A common theme in big data systems is that the source data is diverse, and doesn’t fall into neat relational structures. It could be text from social networks, image data, a raw feed directly from a sensor source. None of these things come ready for integration into an application. … The phenomenon of big data is closely tied to the emergence of data science, a discipline that combines math, programming and scientific instinct. Benefiting from big data means investing in teams with this skillset, and surrounding them with an organizational willingness to understand and use data for advantage. … If you pick a real business problem, such as how you can change your advertising strategy to increase spend per customer, it will guide your implementation. While big data work benefits from an enterprising spirit, it also benefits strongly from a concrete goal.”
Beye: “What is This Thing Called Big Data? – It’s difficult to avoid big data these days. More correctly, it’s difficult to avoid the phrase ‘big data.’ It has become such an integral part of the sales pitches of so many vendors and the blog posts of so many experts that one might be forced to conclude that big data is all-pervasive. The truth is far more complex. Even a definition of big data is elusive. … Big data is not, in essence, something entirely new. The problem is, to a large extent, one of scale; hence the name. However, the insights we currently have into these categories listed earlier and the different tools and approaches they require must be carried forward into how we handle these same data categories at a larger scale. … As a result, depending on your point of view, big data appears either as a giant wave of business opportunity or a huge precipice of potential technological and management pain.”
Beye: “What is the Importance and Value of Big Data? – Recognizing that big data has long been with us allows us to look at the historical value of big data, as well as current examples. This allows a wider sample of use cases, beyond the Internet giants who are currently leading the field in using big data. This leads us to the identification of value in two broad categories: pattern discovery and process invention. … Clearly, discovering a pattern in, for example, customer behavior may be very interesting, but the real value occurs when we put that discovery to use by changing something that reduces costs or increases sales. … More recently, combining data sets from multiple sources, both related and unrelated, with increasing emphasis on computer logs such as clickstreams and publicly available data sets has become popular. … The second approach to getting business value from big data involves using the data operationally to invent an entirely new process or substantially re-engineer an existing one. … For those contemplating investment in big data, the most important conclusion from this article is to recognize that there are very specific combinations of circumstances in which big data can drive real business value. Sometimes, of course, it is the price for simply staying in the game…“