Google Developers Blog: google cloud storage
COLLECTED BY
Organization:
Internet Archive
These crawls are part of an effort to archive pages as they are created and archive the pages that they refer to. That way, as the pages that are referenced are changed or taken from the web, a link to the version that was live when the page was written will be preserved.
Then the Internet Archive hopes that references to these archived pages will be put in place of a link that would be otherwise be broken, or a companion link to allow people to see what was originally intended by a page's authors.
The goal is to
fix all broken links on the web .
Crawls of supported "No More 404" sites.
A daily crawl of more than 200,000 home pages of news sites, including the pages linked from those home pages. Site list provided by
The GDELT Project
The Wayback Machine - https://web.archive.org/web/20181009155107/https://developers.googleblog.com/search/label/google%20cloud%20storage
By Julia Ferraioli, Developer Advocate, Google Compute Engine Cross-posted from the Google Open Source Blog
GitHub ! The GitHub organization for the Google Cloud Platform is your destination for samples and tools relating to App Engine , BigQuery , Compute Engine , Cloud SQL , and Cloud Storage . Most Google Cloud Platform existing open source tools will be migrated to the organization over time. You can quickly get your app running by forking any of our repositories and diving into the code.guest book app on Google App Engine. For good measure, you will also see some tools that will make your life easier, such as an OAuth 2.0 helper .getting started with Python on Google Cloud Storage to monitoring your Google Compute Engine instances with App Engine , our GitHub organization is home to it all.Trick of the trade: to find samples relating to a specific platform, try filtering on the name in the “Find a Repository” text field. pull requests . If you’re interested in seeing what a code review looks like for Google’s open source code, you can follow along with the discussion happening right on the commits.suggestions for samples . We look forward to seeing what you create!Julia Ferraioli is a Developer Advocate for Google Compute Engine, based in Seattle. She helps developers harness the power of Google's infrastructure to tackle their computationally intensive processes and jobs. She comes from an industrial background in software engineering, and an academic background in machine learning and assistive technology.Posted by Scott Knaster , Editor
By Dave Barth, Product Manager
Cross-posted with the Official Google Enterprise Blog
Earlier this week, we
announced a collection of improvements across Google Cloud Platform including 36 new Compute Engine instances, Durable Reduced Availability (DRA) storage, Object Versioning, and European datacenter support. We also announced that we are reducing the price of standard Google Cloud Storage by over 20%.
We are committed to delivering the best value in the marketplace to businesses and developers looking to operate in the cloud. That’s why today we are reducing the price of Google Cloud Storage by an additional 10%, resulting in a total price reduction of over 30%. This price reduction applies to all Cloud Storage regions and the new DRA Storage.
Find out more about the new
Cloud Storage pricing and
sign up now to get started.
Dave Barth is a Product Manager on the Google Cloud Storage team, based in Seattle. He is idealistic about the capacity of technology to change the world.
Posted by Raj Sarkar
By Artem Livshits, CEO of OblakSoft This guest post was written by Artem Livshits, CEO of OblakSoft , which makes the ClouSE MySQL storage engine for cloud development. In this post, Artem describes his experience using Google Cloud Storage to store and serve a WordPress blog. WordPress is popular blogging software used by over 60 million people. If you have a WordPress blog, you want to ensure that your server load is manageable and that your load times are fast. You also want your data to be protected in case your server fails. With that in mind, we at OblakSoft created the Cloud Storage Engine for MySQL (ClouSE). It stores all your WordPress data on Google Cloud Storage , taking the load off your server to improve reliability and speed, and to reduce hosting costs.WP2Cloud WordPress plugin we created to upload pictures (and other media files) to Google Cloud Storage. ClouSE makes the web server stateless by storing all data in Google Cloud Storage using the Google Cloud Storage API . Web pages (lightweight HTML) are served by WordPress, while media files are served by Google Cloud Storage directly.Keep the data highly available and highly durable.
Serve media files in a highly scalable fashion.
Distribute media files across the globe for fast access.
Launch your own WordPress site in the cloud today - it’s easy and there’s minimal setup. We found it easy to make ClouSe work with Google Cloud Storage, and you can see how you can integrate Google Cloud Storage into your app as well.Artem Livshits is the Founder, CEO and software architect at OblakSoft, a company focusing on technologies that simplify adoption of cloud computing. Previously Artem led the development of several server products from inception to maturity during his 12 years at Microsoft, including the source control system managing most of the Microsoft code base. Posted by Scott Knaster , Editor
By Jessie Jiang, Product Management Director (Cross-posted on the Official Google Enterprise Blog .)
introduced a major update to Google Cloud SQL providing faster performance, larger databases (100GB), an EU zone, and a no-cost trial . But, we know there is more to do. Today, we’re continuing to improve the platform with new storage and compute capabilities, significantly lower prices, and more European Datacenter support.
Lower storage prices and new Durable Reduced Availability (DRA) Storage
Updated 3:23 PM to provide more details about DRA. reducing the price of standard Google Cloud Storage by over 20% and introducing a limited preview of Durable Reduced Availability (DRA) storage. DRA storage lowers prices by reducing some data availability, while maintaining the same latency performance and durability as standard Google Cloud Storage. This makes it a great option for batch compute jobs that can easily be rescheduled or for data backup where quick access to your data is important. DRA achieves cost savings by keeping fewer redundant replicas of data. Unlike other reduced redundancy cloud storage offerings, DRA is implemented in a manner that maintains data durability so you don't have to worry about losing your data in the cloud.
Object Versioning . You can also use it to help protect against deleting or overwriting your data by mistake or due to an application error.
More European Datacenter support
European Datacenter support . Now, customers using Google App Engine, Google Cloud Storage, Google Cloud SQL and (soon) Google Compute Engine can deploy their applications, data and virtual machines to European Datacenters. This helps bring your solutions even closer to your customers for faster performance and enables international redundancy.
36 New Compute Engine instance types and overall reduced prices
introduced a Limited Preview of Google Compute Engine with four standard instance types. Today, we are announcing 36 additional instance types and are reducing the price of our original 4 standard instances by about 5% for those currently in our preview. In the coming weeks, the following will be available:
High Memory Instance - High performance instances tailored for applications that demand large amounts of memory.High CPU Instance - Reduced cost option when applications don’t require as much memory.Diskless Configurations - Lower cost options for applications that do not require ephemeral disk and can exclusively utilize persistent disk.
Persistent Disk Snapshotting which makes it simple to instantly create a backup of your disk, move it around Google datacenters, and use the snapshot to start up a new VM.
Cloud Storage pricing and Compute Engine instances . Sign up now and get started today.
Jessie Jiang is the Product Management Director, Google Cloud Platform. She is passionate about building the best platform for developers and businesses in the cloud.
Posted by Scott Knaster , Editor
By Craig McLuckie, Product Manager, Google Compute Engine Google Compute Engine , an Infrastructure-as-a-Service product that lets you run Linux Virtual Machines (VMs) on the same infrastructure that powers Google. This goes beyond just giving you greater flexibility and control; access to computing resources at this scale can fundamentally change the way you think about tackling a problem.Scale . At Google we tackle huge computing tasks all the time, like indexing the web, or handling billions of search queries a day. Using Google's data centers, Google Compute Engine reduces the time to scale up for tasks that require large amounts of computing power. You can launch enormous compute clusters - tens of thousands of cores or more.
Performance . Many of you have learned to live with erratic performance in the cloud. We have built our systems to offer strong and consistent performance even at massive scale. For example, we have sophisticated network connections that ensure consistency. Even in a shared cloud you don’t see interruptions; you can tune your app and rely on it not degrading.
Value . Computing in the cloud is getting even more appealing from a cost perspective. The economy of scale and efficiency of our data centers allows Google Compute Engine to give you 50% more compute for your money than with other leading cloud providers. You can see pricing details here .Compute . Launch Linux VMs on-demand. 1, 2, 4 and 8 virtual core VMs are available with 3.75GB RAM per virtual core.
Storage . Store data on local disk, on our new persistent block device, or on our Internet-scale object store, Google Cloud Storage .
Network . Connect your VMs together using our high-performance network technology to form powerful compute clusters and manage connectivity to the Internet with configurable firewalls.
Tooling . Configure and control your VMs via a scriptable command line tool or web UI. Or you can create your own dynamic management system using our API.RightScale , Puppet Labs , OpsCode , Numerate , Cliqr and MapR - to integrate their products with Google Compute Engine. These partners offer management services that make it easy for you to move your applications to the cloud and between different cloud environments. here . We’re going to pace ourselves and start with Google Compute Engine in limited preview (sign up here ), but our goal is to give you all the pieces you need to build anything you want in the cloud. Whether you need a platform like Google App Engine, or virtual machines like Google Compute Engine, these days, you define your limits. We’re just at the start of what the cloud can do.Craig McLuckie is the Product Management Lead for Google Compute Engine. He spends his days working with an amazing engineering team to open Google’s infrastructure to the world. Posted by Scott Knaster , Editor
Ville
Navneet
By Navneet Joneja, Product Manager, 1. Network Serve the request from as close to the user as possible
Optimize the network routing between the end-user and the service, including avoiding pockets of network congestion and minimizing the number of network hops between the user and the service.
2. Storage Google Cloud Storage is built on Google’s proprietary network and datacenter technology. We’ve spent more than a decade building out proprietary infrastructure and technology to power Google’s sites (after all, we believe that fast is better than slow ). When you use Google Cloud Storage, the same network goes to work for your data.
We replicate data to multiple data centers and serve an end-user’s request from the nearest data center that holds a copy of the data. We also offer a choice of regions (currently U.S. and Europe) to allow you to keep your data close to where it’s most needed. We then take this one step further. When you upload an object and mark it as cacheable (by setting the standard HTTP Cache-Control header), we automatically figure out how best to serve it using Google’s broad network footprint, including caching it closer to the end-user if possible.
Finally, you don’t need to worry about optimizing your storage layout (like you would on a physical disk), or the lookups (i.e. directory and naming structure) like you would on most file systems and some other storage services. We take care of all the "file system" optimizations behind the scenes.
Google Cloud Storage , we do all the background work to make it fast so that you can focus on your application.Navneet Joneja loves being at the forefront of the next generation of simple and reliable software infrastructure, the foundation on which next-generation technology is being built. When not working, he can usually be found dreaming up new ways to entertain his intensely curious almost-two-year-old. Ville Aikas likes to work on tools and services that make developers lives easier and "just work". When not busy cranking out code, he loves to play soccer with his kids, build robots and watch F1. Posted by Scott Knaster , Editor
By Navneet Joneja, Product Manager Google Cloud Storage enables you to use our storage and network infrastructure to store and access your data with high reliability , scale and performance. Today, we’re launching several frequently requested new features:Signed URLs and updated browser uploads short-lived signed URLs to address any object stored in Google Cloud Storage. This feature gives your application another powerful tool to control access to any piece of data. You can also use this feature to enable browser-based uploads from your end users to Google Cloud Storage without requiring them to have Google accounts (browser-based uploads were previously limited to the interoperable API). URL signing is implemented using PKCS-12 keys and the industry-standard RSA algorithm and is currently experimental.Cross-Origin Resource Sharing configuring storage buckets to return appropriate Cross-Origin Resource Sharing (CORS) headers, which streamlines the development of advanced JavaScript applications (such as browser-based games) using Google Cloud Storage. Other uses include serving web fonts from Google Cloud Storage and enabling trusted JavaScript access from your App Engine applications.gsutil 3.0 A refactored, cleaner code-base
Better in-tool documentation
Easy in-place update to new releases
Multithreaded operations
A hierarchical file tree abstraction layer that maps more closely to the way traditional file systems are organized.
zip , tarball ). Please note that wildcard and list bucket semantics have changed in gsutil to make the tool easier to use in a broad variety of use cases. You can read all about the latest update in the release notes .prices across all usage tiers by up to 15%.discussion group . If you haven’t tried Google Cloud Storage yet, you can sign up and get started here .Navneet Joneja loves being at the forefront of the next generation of simple and reliable software infrastructure, the foundation on which next-generation technology is being built. When not working, he can usually be found dreaming up new ways to entertain his intensely curious almost-two-year-old. Posted by Scott Knaster , Editor
