segunda-feira, 7 de maio de 2012
FxGqlC: Define the columns of an input text file using a regular expression
An input text file can be parsed into columns using a regular expression, using the new FROM-clause option " -Columns='<regular expression>' ". The input line is matched against the regular expression. If there is no match, the line is ignored. If the line matches, the first match is used, and the columns are filled with the named "capture groups" of the regulare expression. The syntax to define a capture group in .net regular expressions is: "(?<MyColumnName>MyFilter)". For example: "(?<Count>\d+)". The column name can then be used in any expression like the WHERE-clause. This feature is added in version 2.1.
Example:
select distinct [Tournament] from ['Tennis-ATP-2011.csv' -columns='^(?<ATP>.*?)\t(?<Location>.*?)\t(?<Tournament>.*?)\t.*?$']
More information on using regular expressions, can be found on this site: http://www.regular-expressions.info/ .
For the usage of "Capture Groups", see the section "Named Capture with .NET’s System.Text.RegularExpressions" on this link: http://www.regular-expressions.info/named.html
More information on: https://sites.google.com/site/fxgqlc
Google, the World Wide Web and WWW conference: years of progress, prosperity and innovation
More than forty members of Google’s technical staff gathered in Lyon, France in April to participate in the global dialogue around the state of the web at the World Wide Web conference (WWW) 2012. A decade ago, Larry Page and Sergey Brin applied their research to an information retrieval problem and their work—presented at WWW in 1998—led to the invention of today’s most popular search engine.
As I've watched the WWW conference series evolve over the years, a couple of larger trends struck me in this year's edition. First, there seems to be more of a Mobile Web presence in the technical program, relative to recent years. The refereed program included several interesting Mobile papers, including the Best Student Paper Awardee from Stanford University researchers: Who Killed My Battery: Analyzing Mobile Browser Energy Consumption, Narendran Thiagarajan, Gaurav Aggarwal, Angela Nicoara, Dan Boneh, Jatinder Singh.
Second, one gets the sense that the WWW community is moving from the classic "bag of words" view of web pages, to an entity-centric view. There were a number of papers on identifying and using entities in Web pages. While I'm loathe to view this as a vindication of "the Semantic Web" (mainly because this has become an overloaded phrase that people elect to interpret as suits them), the technical capability to get at entities is clearly here. The question is -- what is the killer application? Finally, it’s nice to see that recommendation systems are becoming a major topic of focus at WWW. This paper was a personal favorite: Build Your Own Music Recommender by Modeling Internet Radio Streams, Natalie Aizenberg, Yehuda Koren, Oren Somekh.
In keeping with tradition, Google was a major supporter, sponsoring the conference, the Best Paper Award (Counting beyond a Yottabyte, or how SPARQL 1.1 Property Paths will prevent adoption of the standard, Marcelo Arenas, Sebastián Conca and Jorge Pérez) and four PhD student travel grants. We chatted with hundreds of attendees who hung out with us at the Google booth to chat and see demos about the latest Google product and research developments (see full schedule of booth talks).
Googlers were also active member of the vibrant research community at WWW:
David Assouline delivered the keynote for the Demo Track -- to a standing-room-only crowd -- on the Google Art Project, which uses a combination of various Google technologies and expert information provided by our museum partners to create a unique online art experience. Googler Alon Halevy served as a program committee member. Googlers were also co-authors of the following papers:
- Risk-Aware Revenue Maximization in Display Advertising by Ana Radovanovic and William Heavlin (Googlers)
- SessionJuggler: Secure Web Login From an Untrusted Terminal Using Session Hijacking by Elie Bursztein (Googler), Chinmay Soman, Dan Boneh and John Mitchell
- Spotting Fake Reviewer Groups in Consumer Reviews by Arjun Murkherjee, Bing Liu, and Natalie Glance (Googler)
- Your Two Weeks of Fame and Your Grandmother’s by James Cook, Atish Das Sarma, Alexander Fabrikant and Andrew Tomkins (Googlers)
- YouTube Around the World: Geographic Popularity of Videos by Mirjam Wattenhofer (Googler), Anders Brodersen (Googler), and Salvatore Scellato
- Who Killed My Battery: Analyzing Mobile Browser Energy Consumption by Narendran Thiagarajan, Gaurav Aggarwal (Googler), Angela Nicoara, Dan Boneh and Jatinder Singh
- A Multimodal Search Engine based on Rich Unified Content Description by Thomas Steiner (Googler), Lorenzo Sutton, Sabine Spiller, Marilena Lazzaro, Francesco Saverio Nucci, Vincenzo Croce, Alberto Massari, Antonio Camurri, Anne Verroust-Blondet, Laurent Joyeux
- Enabling on-the-fly Video Shot Detection on YouTube by Thomas Steiner (Googler), Ruben Verborgh, Joaquim Gabarro, Michael Hausenblas, Raphael Troncy and Rik Van De Walle
- Fixing the Web one page at a time, or actually implementing xkcd #37 by Thomas Steiner (Googler), Ruben Verborgh, and Rik Van de Valle
- Appification of the Web by Ed Chi (Googler), Brian Davison, and Evgeniy Gabrilovich (Googler)
- Extracting Unambiguous Keywords from Microposts Using Web and Query Logs Data, as part of the Making Sense of Microsposts workshop by Davi Reis, Felipe Portavales Goldstein, and Fred Quintao (Googlers)
- Human Computation Must Be Reproducible, as part of the CrowdSearch: Crowdsourcing Web search workshop by Praveen Paritosh (Googler)
- WebQuality 2012: The Anti-Social Web by Zoltan Gyongyi (Googler), Carlos Castillo, Adam Jatowt, and Katsumi Tanaka
- The Role of Human-Generated and Automatically-Extracted Lexico-Semantic Resources in Web Search by Marius Pasca (Googler)
- Google Image Swirl by Yushi Jing, Henry Rowley, Jingbin Wang, David Tsai, Chuck Rosenberg, Michele Covell (Googlers)
Add Research at Google to your circles on G+ to learn more about our academic conference involvement, view pictures from events, and hear about upcoming programming and presence at conferences
domingo, 6 de maio de 2012
Exclude your own visits to your website from Google Analytics
When you have a small website, your own visits to your site can count for a substantial part in the total statistics of Google Analytics.
There are different ways to exclude yourself from your own statistics. E.g. by changing the javascript code that invokes Google Analytics / Urchin, or by installing a custom cookie and filtering out the visits containing the cookie.
By far the easiest way exclude yourself from your statistics, is by installing a browser add-on that doesn't invoke Google Analytics. Google developed an add-in for all mainstream browsers that make you "opt-out" of Google Analytics: "Google Analytics Opt-out Browser Add-on (BETA)"
https://tools.google.com/dlpage/gaoptout
My favorite is an add-in that let's you configure for which individual sites (e.g, your own ones) that you want to turn off Google Analytics: "Block Yourself from Analytics"
https://chrome.google.com/webstore/detail/fadgflmigmogfionelcpalhohefbnehm
There are different ways to exclude yourself from your own statistics. E.g. by changing the javascript code that invokes Google Analytics / Urchin, or by installing a custom cookie and filtering out the visits containing the cookie.
By far the easiest way exclude yourself from your statistics, is by installing a browser add-on that doesn't invoke Google Analytics. Google developed an add-in for all mainstream browsers that make you "opt-out" of Google Analytics: "Google Analytics Opt-out Browser Add-on (BETA)"
https://tools.google.com/dlpage/gaoptout
My favorite is an add-in that let's you configure for which individual sites (e.g, your own ones) that you want to turn off Google Analytics: "Block Yourself from Analytics"
https://chrome.google.com/webstore/detail/fadgflmigmogfionelcpalhohefbnehm
Chrome: What content is secure?
When browsing to a secure site, you can get a warning about insecure content being shown. In Chrome, this is indicated by a padlock with a yellow triangle. When clicking this icon, you get information about the certificate being used, with this warning message: (in this example for gmail)
Your connection to mail.google.com is encrypted with 128-bit encryption. However, this page includes other resources which are not secure. These resources can be viewed by others while in transit and can be modified by an attacker to change the look of the page.
To know what content is secure or insecure on a website, you can install the free Google Chrome extension "Secure or not".
On the right side of the Chrome address bar, a button is added containing a padlock with a question mark. When pressing the button, all secure content is surrounded with a green dashed line, and all insecure content with a red dashed line.
sexta-feira, 4 de maio de 2012
Video Stabilization on YouTube
One thing we have been working on within Research at Google is developing methods for making casual videos look more professional, thereby providing users with a better viewing experience. Professional videos have several characteristics that differentiate them from casually shot videos. For example, in order to tell a story, cinematographers carefully control lighting and exposure and use specialized equipment to plan camera movement.
We have developed a technique that mimics professional camera moves and applies them to videos recorded by hand-held devices. Cinematographers use specialized equipment such as tripods and dollies to plan their camera paths and hold them steady. In contrast, think of a video you shot using a mobile phone camera. How steady was your hand and were you able to anticipate an interesting moment and smoothly pan the camera to capture that moment? To bridge these differences, we propose an algorithm that automatically determines the best camera path and recasts the video as if it were filmed using stabilization equipment. Specifically, we divide the original, shaky camera path into a set of segments, each approximated by either a constant, linear or parabolic motion of the camera. Our optimization finds the best of all possible partitions using a computationally efficient and stable algorithm. For details, check out our earlier blog post or read our paper, Auto-Directed Video Stabilization with Robust L1 Optimal Camera Paths, published in IEEE CVPR 2011.
The next time you upload your videos to YouTube, try stabilizing them by going to the YouTube editor or directly from the video manager by clicking on Edit->Enhancements. For even more convenience, YouTube will automatically detect if your video needs stabilization and offer to do it for you. Many videos on YouTube have already been enhanced using this technology.
More recently, we have been working on a related problem common in videos shot from mobile phones. The camera sensors in these phones contain what is known as an electronic rolling shutter. When taking a picture with a rolling shutter camera, the image is not captured instantaneously. Instead, the camera captures the image one row of pixels at a time, with a small delay when going from one row to the next. Consequently, if the camera moves during capture, it will cause image distortions ranging from shear in the case of low-frequency motions (for instance an image captured from a driving car) to wobbly distortions in the case of high-frequency perturbations (think of a person walking while recording video). These distortions are especially noticeable in videos where the camera shake is independent across frames. For example, take a look at the video below.
Original video with rolling shutter distortions
In our recent paper titled Calibration-Free Rolling Shutter Removal, which was awarded the best paper at IEEE ICCP 2012, we demonstrate a solution to correct these rolling shutter distortions in videos. A significant feature of our approach is that it does not require any knowledge of the camera used to shoot the video. The time delay in capturing two consecutive rows that we mention above is in fact different for every camera and affects the extent of distortions. Having knowledge of this delay parameter can be useful, but difficult to obtain or estimate via calibration. Imagine a video that is already uploaded to YouTube -- it will be challenging to obtain this parameter! Instead, we show that just the visual data in the video has enough information to appropriately describe and compensate for the distortions caused by the camera motion, even in the presence of a rolling shutter. For more information, see the narrated video description of our paper.
This technique is already integrated with the YouTube stabilizer. Starting today, if you stabilize a video from a mobile phone or other rolling shutter cameras, we will also automatically compensate for rolling shutter distortions. To see our technique in action, check out the video below, obtained after applying rolling shutter compensation and stabilization to the one above.
After stabilization and rolling shutter removal
An Experiment in Music and Crowd-Sourcing
The Bodleian Library is the main research library at the University of Oxford. It is also one of the oldest libraries in the world, dating back to the 14th century. But the staff of the Bodleian operates very much in the 21st century, using the latest technology to solve their unique problems.
A few years ago, the library acquired a set of 4,000 popular piano pieces from the mid-Victorian period. There’s very little information available on these pieces, so Bodleian staff decided to use crowdsourcing to collect information on this corpus of music. Through a Google Focused Award, they have digitized and made the entire set of music available online.
By visiting the What’s-the-Score website, which opened yesterday, ‘citizen librarians’ can help by describing the scores and contributing to the creation of an online catalogue. They can also include links to audio or video recordings. This is the first time the Bodleian has used this approach to collect catalog information. Typically, a large group of researchers are required to find this information.
Martin Holmes, Alfred Brendel Curator of Music at the Bodleian Libraries, commented: ‘In making the scores available online, they will not only be accessible for academic study and research but will also be there to enjoy for anyone who is interested in various aspects of Victorian music, culture and society.’
The Bodleian Library is one of dozens of recipients of Google Focused Awards. These awards are for research in areas of study that are of key interest to Google as well as the research community. These unrestricted gifts are for two to three years, and the recipients have the advantage of access to Google tools, technologies, and expertise. The Bodleian’s experiment in crowdsourcing to build up data on a specialized collection is timely and interesting, given the number of such collections becoming available on the web.
Help Desk Hangouts: Display Network Advertising with Google AdWords
Editor’s note: Each week on the Google+ Your Business page, we’re putting you in touch with Googlers and users who can help you as a business owner get the most out of our products and features.
In our latest Help Desk Hangout On Air, we discussed advertising on the Google Display Network with Googlers Dori Storbeck, Courtney Pannell, Joanna Kim, Neil Mendelowitz, and two Top Contributors from the AdWords Community — Kim Clinkunbroomer and Theresa Zook. The group shared tips and tricks for the Display Network, and the TCs shared some of their personal experiences. If you missed it, you can watch the full hour-long Hangout on the Google Business YouTube channel (check out the video description for a minute-by-minute breakdown):
Here are a few of the questions you asked us to answer during the Hangout:
Can independent consultants take advantage of the Display Network?
Yes, anyone can utilize the Display Network for advertising their products and services; however, whether it is right for you may depend on your specific business and your advertising goals.
Where is the Display Network available?
The Display Network is available in all countries that AdWords serves.
Which clicks are more likely to become conversions search or display?
Search and display perform very differently, depending on your overall campaign goals.
What’s more effective: automatic placements or manual?
If you’re trying to reach a specific audience or target users who demonstrate a particular interest and you have an idea of some Display Network websites where you want your ads to appear, managed placements are probably the best bet for you. If you’re just starting out with Display, we would suggest opting into automatic placements at first and then reviewing the domains you show on to further refine and optimize.
If in your industry search approximate cpc is = to display approximate cpc why would you do display?(Besides the obvious increase in potential traffic.)
The Display Network is a great way to find customers that may not be actively searching for your product. Other than potentially increasing traffic to your website, you can potentially grow your customer base and get more conversions.
Tips on how to get JPEG ads approved quickly?
Our ad review turn around time is usually 1-3 business days. If your ads are under review for more than 3 business days, please get in touch with us or submit your ads directly to our review team.
For remarketing, how do I set the ad up to show people the products they viewed but not purchased?
You can create different audience lists so that you create an audience for users who visited your product pages and users who completed a purchase. You can then create a “custom combination” list to subtract those who purchased from those who visited your pages and did not purchase.
What is the difference between topics and interest categories? How are these compiled?
Topic targeting allows you to place ads on pages directly related to the topic you've selected, whereas interest categories allow you to reach users across the Display Network who have shown specific interests, regardless of the page they're currently on.
For remarketing, would you suggest using just one method per ad group, i.e., contextual, topic, interest, managed placements, or is it OK to mix them?
Remarketing operates by showing your ads to users on your audience list, so within your ad group, the audience list should be the only targeting you have set up.
If you could only choose between search and display and the approximate cpc was the same. Which would you chose and why?
This question really depends on your business and your advertising goals. In general, we tend to see advertisers looking for more direct response focus on the Search Network, while those who are interested in branding and remarketing might want to focus on the Display Network.
Of course, if you’re interested in both, we’d recommend creating a specific campaign to target each network individually.
Any suggestions on frequency capping numbers?
When you turn on frequency capping for a campaign, you can set a limit for the number of impressions you allow an individual user to have per day, per week, or per month, and you can choose whether this is applicable to each ad, ad group, or campaign. So ultimately, the frequency capping number you select depends on your goals and the size of your advertising endeavor. Kim and Theresa suggested numbers around 5-15 impressions per day for an individual user.
I know there is a placement tool in AdWords - however it doesn’t seem to show "all" of the websites available in the network. I have found sites displaying relevant ads, but I did not find it in tool. Is there another way to identify these potential sites?
Yes! In addition to our Placement Tool, you can check the DoubleClick Ad Planner for other sites that are in the Display Network.
To learn more about how to get started with the Display Network, visit our Help Center or check out the AdWords Community forum. And remember to tune in to the live stream of our next Hangout at 11 a.m. PT Wednesday May 9 — topic to be announced on the Google+ Your Business page early next week!
Posted by Dori Storbeck and Courtney Pannell, Global Online Advertising Associates
In our latest Help Desk Hangout On Air, we discussed advertising on the Google Display Network with Googlers Dori Storbeck, Courtney Pannell, Joanna Kim, Neil Mendelowitz, and two Top Contributors from the AdWords Community — Kim Clinkunbroomer and Theresa Zook. The group shared tips and tricks for the Display Network, and the TCs shared some of their personal experiences. If you missed it, you can watch the full hour-long Hangout on the Google Business YouTube channel (check out the video description for a minute-by-minute breakdown):
Can independent consultants take advantage of the Display Network?
Yes, anyone can utilize the Display Network for advertising their products and services; however, whether it is right for you may depend on your specific business and your advertising goals.
Where is the Display Network available?
The Display Network is available in all countries that AdWords serves.
Which clicks are more likely to become conversions search or display?
Search and display perform very differently, depending on your overall campaign goals.
What’s more effective: automatic placements or manual?
If you’re trying to reach a specific audience or target users who demonstrate a particular interest and you have an idea of some Display Network websites where you want your ads to appear, managed placements are probably the best bet for you. If you’re just starting out with Display, we would suggest opting into automatic placements at first and then reviewing the domains you show on to further refine and optimize.
If in your industry search approximate cpc is = to display approximate cpc why would you do display?(Besides the obvious increase in potential traffic.)
The Display Network is a great way to find customers that may not be actively searching for your product. Other than potentially increasing traffic to your website, you can potentially grow your customer base and get more conversions.
Tips on how to get JPEG ads approved quickly?
Our ad review turn around time is usually 1-3 business days. If your ads are under review for more than 3 business days, please get in touch with us or submit your ads directly to our review team.
For remarketing, how do I set the ad up to show people the products they viewed but not purchased?
You can create different audience lists so that you create an audience for users who visited your product pages and users who completed a purchase. You can then create a “custom combination” list to subtract those who purchased from those who visited your pages and did not purchase.
What is the difference between topics and interest categories? How are these compiled?
Topic targeting allows you to place ads on pages directly related to the topic you've selected, whereas interest categories allow you to reach users across the Display Network who have shown specific interests, regardless of the page they're currently on.
For remarketing, would you suggest using just one method per ad group, i.e., contextual, topic, interest, managed placements, or is it OK to mix them?
Remarketing operates by showing your ads to users on your audience list, so within your ad group, the audience list should be the only targeting you have set up.
If you could only choose between search and display and the approximate cpc was the same. Which would you chose and why?
This question really depends on your business and your advertising goals. In general, we tend to see advertisers looking for more direct response focus on the Search Network, while those who are interested in branding and remarketing might want to focus on the Display Network.
Of course, if you’re interested in both, we’d recommend creating a specific campaign to target each network individually.
Any suggestions on frequency capping numbers?
When you turn on frequency capping for a campaign, you can set a limit for the number of impressions you allow an individual user to have per day, per week, or per month, and you can choose whether this is applicable to each ad, ad group, or campaign. So ultimately, the frequency capping number you select depends on your goals and the size of your advertising endeavor. Kim and Theresa suggested numbers around 5-15 impressions per day for an individual user.
I know there is a placement tool in AdWords - however it doesn’t seem to show "all" of the websites available in the network. I have found sites displaying relevant ads, but I did not find it in tool. Is there another way to identify these potential sites?
Yes! In addition to our Placement Tool, you can check the DoubleClick Ad Planner for other sites that are in the Display Network.
To learn more about how to get started with the Display Network, visit our Help Center or check out the AdWords Community forum. And remember to tune in to the live stream of our next Hangout at 11 a.m. PT Wednesday May 9 — topic to be announced on the Google+ Your Business page early next week!
Posted by Dori Storbeck and Courtney Pannell, Global Online Advertising Associates
Assinar:
Postagens (Atom)