Google Gemini: News & Updates

[Nairrk]

Google announced a bunch of Gemini backed updates for its Workspace apps back in May at its I/O 2024 annual conference. Some of those have now begun rolling out to the public, including the Gemini-powered side panel in Google’s Workspace apps. In addition, Google Gemini in Gmail is now also being made available to power the Email summaries feature on web and the Gmail app. Here are all the details.

As announced on the Google Workspace blog, Gemini in the side panel of Docs, Sheets, Slides, and Drive is now available for eligible accounts. Through the side panel, Gemini can assist you with summarising, analysing, and generating content by accessing the content gathered from your emails, documents, and more, without switching applications or tabs.

Google says that the updated interface automatically summarises the content you’re working on and provides contextually relevant prompts to help you get started. The side panel will use Google’s most capable models including the Gemini 1.5 Pro model with a longer context window and more advanced reasoning, allowing you to fully utilise the power and capabilities of Gemini directly from your most used Google Workspace apps.

The new side panel with Gemini integration is available for Google Workspace customers with:

• Gemini Business and Enterprise add-on
• Gemini Education and Education Premium add-on
• Google One AI Premium account

Email Summaries Powered By Gemini In Gmail
In addition to the Gemini-powered side panel, Gmail is also getting the “Summarise this email” button which is also backed up by Google’s AI model. Built to leverage Google’s most capable models, including the Gemini 1.5 Pro model, you can now use Gemini in Gmail on web to:

• Summarize an email thread
• Suggest responses to an email thread
• Get help drafting an email
• Ask questions and find specific information from emails within your inbox or from your Google Drive files

You can also use Google Gemini in the Gmail mobile App on Android and iOS to analyse email threads and see a summarised view with the key highlights, just as you can with the side panel on the web. Gemini in Gmail also connects to other Workspace apps which means you can tell Gemini to fetch your data from an app like Sheets to input that data in one of your Email replies you want to make via Gmail. The company confirmed that additional mobile features like Contextual Smart Reply and Gmail Q&A are coming soon.

Availability of this feature remains the same as the Gemini-powered side panel in Workspace apps.

Themobileindian

 

[Nairrk]

I just tried how this Gemini app works. On opening the app, a page comes like as below:

When we open the app for the first time, the two lines which say 'Recent - Leave Letter Format' won't be there. Since I asked for a leave letter format just to check how it works, it has given a letter format and after that it notifies what help I asked recently.

Here is the leave letter format, which received instantly after asking it over the mike.

It seems that the app is working fine and it supports 40 international languages other than English.

Shall keep updated when I find more features from this app.

///

 

[Nairrk]

Gemini can now answer general questions even when your Android phone is locked

Google Gemini was unveiled earlier this year and since then, Google has consistently been updating it with new features and improvements. Another minor but noticeable update Google has introduced for Gemini on Android phones is that it can now answer general questions even when your phone is locked.

As detailed on a Google support page (via 9to5Google), Gemini on Android can now help you with answers to general questions even when your phone is locked. Before the update was introduced, Gemini could only control alarms and timers, media playback, and “some phone features,” like volume adjustment or turn on/off the flashlight.

However, with the introduction of the new feature, Gemini can go beyond these questions and answer those such as “What’s the weather like?,” without needing to unlock your device. If you tap anywhere on the screen after Gemini shows you the response, it asks you to unlock the device. You can trigger Gemini on lock screen by using the “Hey Google” voice command.

To control whether Gemini can help you with answers to general questions when your device is locked:

1. On your Android phone, open Gemini.
2. At the top right, tap your Profile picture and then tap on Settings.
3. Tap Gemini on lock screen.
4. Turn Responses on lock screen on or off.

The “Gemini on lock screen” is the new setting you’ll have to look for if you have received the update. As of writing this article, the option doesn’t appear in Gemini settings on any of our devices.

Google notes that the Gemini mobile App can’t perform some tasks that Google Assistant can perform on lock screen when it is your primary active assistant, like reading messages. In these cases, you’ll need to unlock your phone.

Themobileindian

 

[Nairrk]

New update released

Workspace extensions now available in beta for Gemini for Google Workspace add-on subscribers

• What: Google Workspace admins can now opt in to beta test Gemini extensions for Gmail and Drive for their organisation. Via the Drive extension, organisations can also access information from Google Docs. This enables users to find and summarise information, as well as ground Gemini's responses, from their content. Google Workspace data will not be used to train Gemini's public model, and admins can disable access at any time. Subscription to a Gemini for Google Workspace add-on is required.
• 
  
• Why: Now, Google Workspace users can collaborate with information from select Google Workspace apps, all in one place, bringing Gemini's capabilities into user's daily workflows, enhancing productivity and collaboration.

Gemini

 

[Nairrk]

Google Gemini gets a big upgrade, now performs faster for all users

Google Gemini has received a huge upgrade for those who are on the free tier of the AI chatbot service. Gemini is now being upgraded to Gemini 1.5 Flash AI model by Google that is being touted to bring “across-the-board improvements.” Additionally, Gemini access to Teens is also set to expand in the coming week.

Gemini 1.5 Flash for Unpaid Users
Google announced the Gemini upgrade via a blog post, where it says that with Gemini 1.5 Flash, you’ll notice general improvements in quality and latency, with especially noticeable enhancements in reasoning and image understanding. In addition, it is also quadrupling Gemini’s context window to 32K tokens, allowing users to have longer back-and-forth conversations and ask Gemini more complex questions — all free of charge.

To get the most out of the larger context window, Google will soon add the ability to upload files via Google Drive or directly from your device, which has been available in Gemini Advanced. That means you’ll be able to do things like upload your economics study guide and ask Gemini to create practice questions. ChatGPT also offers a similar functionality via its App on Android and iOS. “Gemini will also soon be able to analyze data files for you, allowing you to uncover insights and visualize them through charts and graphics,” said Google in a blog post.

Gemini 1.5 Flash is now available to all Gemini users on both web and mobile, in more than 40 languages and over 230 countries and territories, including India.

Link to related content in Gemini’s responses
Starting today for English language prompts in certain countries, you can further access additional information on topics directly within Gemini’s responses through links for related content. You’ll have to click on the chip at the end of a paragraph to see websites where you can dive deeper on a certain topic. This isn’t limited to websites, where Google explains that in Gemini’s response references information found using the Gmail extension, you’ll also see inline links to relevant emails.

Expansion to more countries
Starting today, Google is also gradually rolling out Gemini in Google Messages to the European Economic Area (EEA), UK and Switzerland, with the ability to chat in newly added languages like French, Polish and Spanish. It is also rolling out the Gemini mobile app to more countries, so more people around the world can get help from Gemini on the go.

Expanded access to Gemini for Teens
In the coming week, the company will expand Gemini access to teenagers globally, in over 40 languages. Teens who meet the minimum age requirement to manage their own Google Account will be able to access Gemini to do things like better understand school subjects, prepare for university or get help with creative projects.

Themobileindidan

 

[Nairrk]

Gemini makes your mobile device a powerful AI assistant

For years, we’ve relied on digital assistants to set timers, play music or control our smart homes. This technology has made it easier to get things done and saved valuable minutes each day.

Now with generative AI, we can provide a whole new type of help for complex tasks that can save you hours. With Gemini, we’re reimagining what it means for a personal assistant to be truly helpful. Gemini is evolving to provide AI-powered mobile assistance that will offer a new level of help — all while being more natural, conversational and intuitive.

Learn more about the new Gemini features, which will be available on both Android and iOS.

Read

 

[Nairrk]

Google Gemini might soon offer WhatsApp calling and messaging support

Google Gemini has been receiving updates on a regular basis. One major update it received was the Extension support so it could interact with other Google services. Soon, Google might add support for third-party extensions apart from Google’s own, and it could include WhatsApp, allowing Gemini to make calls and send messages via the Messaging platform.

As reported by Android Authority, extension support for WhatsApp in Gemini was discovered through an APK teardown of the Google app version 15.34.32.29.arm64 beta. The description for the WhatsApp extension in Gemini read, “Send messages or make calls through the WhatsApp app on Android.”

While the extension’s description is self-explanatory, it could be a significant feature for Gemini. Billions of people use WhatsApp, and integrating it into its own AI chatbot via extensions could prove advantageous for Google, resulting in more people using Gemini.

Some more new extensions that can be seen in the screenshots shared by the publication include the Phone extension that allows you to make phone calls through the Google Phone app, the Google Messages extension, allowing you to send messages and read them, and the most interesting notifications extension.

The notifications extension will allow Gemini to send or read Android system notifications. This could allow the chatbot to summarise all the notifications you received while you were away from your phone, dismiss certain notifications, control music playback, and do more. While this was just an example, we’ll have to wait and see how Google will implement the feature.

Adding support for newer extensions to increase Gemini’s utility factor has become essential for Google as AI LLMs from various brands become increasingly competitive. Apple has also confirmed that it will bring a revamped Siri later this year, allowing it to interact with third-party apps on supported iPhones and iPads.

Themobileindian

 

[Nairrk]

New in Gemini: Custom Gems and improved image generation with Imagen 3

We have new features rolling out, starting today, that we previewed at Google I/O. Gems, a new feature that lets you customize Gemini to create your own personal AI experts on any topic you want, are now available for Gemini Advanced, Business and Enterprise users. And our new image generation model, Imagen 3, is now available across Gemini, Gemini Advanced, Business and Enterprise.

Create Gems for customized help — from coding to career advice
Over the coming days, Gemini Advanced, Business and Enterprise subscribers can start creating and chatting with Gems, the custom versions of Gemini first previewed at I/O. You can customize Gems to act as an expert on topics or refine them toward your specific goals. Simply write instructions for your Gem, give it a name, and then chat with it whenever you want.

With Gems, you can create a team of experts to help you think through a challenging project, brainstorm ideas for an upcoming event, or write the perfect caption for a social media post. Your Gem can also remember a detailed set of instructions to help you save time on tedious, repetitive or difficult tasks.

To help you get started, we’re launching a set of premade Gems for different scenarios, including:

• Learning coach helps you break down complex topics, making them easier to understand.
• Brainstormer gives you easy inspiration — from fresh ideas for a themed party to the perfect gift for an upcoming birthday.
• Career guide unlocks your career potential with detailed plans to refine your skills and achieve your career goals.
• Writing editor can elevate your writing through clear, constructive feedback on everything from grammar to structure.
• Coding partner levels up your coding skills and can help you build projects and learn as you go.

Gems are now rolling out on desktop and mobile devices to Gemini Advanced, Gemini Business and Gemini Enterprise users in more than 150 countries in most languages.

Generate high-quality images with Imagen 3
We've upgraded our creative image generation capabilities, and over the coming days, we're bringing our latest image generation model, Imagen 3 to Gemini Apps and expanding its availability for users in all languages.

Imagen 3 sets a new standard for image quality, generating images with just a few words. You can even ask Gemini to create images in various styles — like photorealistic landscapes, textured oil paintings or whimsical claymation scenes.

Prompt: Generate an image of glistening dewdrops clinging to a velvety red rose petal. Capture the intricate details of the water droplets, reflecting the morning sunlight, and the delicate veins of the petal.​

Imagen 3 brings advanced image generation capabilities that come with built-in safeguards and adhere to our product design principles. Across a wide range of benchmarks, Imagen 3 performs favorably compared to other image generation models available. And as with Imagen 2, we use SynthID, our tool for watermarking AI-generated images.

Our design principles are clear: From start to finish, you remain in control of the creative process. If the initial image you get doesn’t meet your expectations, simply tell Gemini what you’d like to change and it’ll give you a new image.

Over the coming days, we’ll also start to roll out the generation of images of people, with an early access version for our Gemini Advanced, Business, and Enterprise users, starting in English. We’ve worked to make technical improvements to the product, as well as improved evaluation sets, red-teaming exercises and clear product principles.

With Imagen 3, we’ve made significant progress in providing a better user experience when generating images of people. We don’t support the generation of photorealistic, identifiable individuals, depictions of minors or excessively gory, violent or sexual scenes. Of course, not every image Gemini creates will be perfect, but we’ll continue to listen to feedback from early access Gemini Advanced users as we keep improving. We'll gradually roll this out, aiming to bring it to more users and languages soon.

blog.google

 

[Nairrk]

Gemini app rolling out file upload on Android, iOS

Following Live and more Extensions, the Gemini mobile app is rolling out support for file uploads instead of having to use gemini.google.com. This requires Gemini Advanced.

A sheet slides up three options on Android: Upload a file, Upload from gallery (system photo picker), and Upload from Drive. The last option does not exist in Gemini (Google Search app) on iOS. It matches the options on gemini.google.com, with the following file types supported:

• Plain text files: TXT
• Document files: DOC, DOCX, PDF, RTF, DOT, DOTX, HWP, HWPX
• Documents created in Google Docs
• Tabular data files: CSV, TSV
• Spreadsheet files: XLS, XLSX
• Spreadsheets created in Google Sheets

Be mindful of exceeding the context window:

Important: Up to 10 files can be uploaded at a time, and each file can be up to 100 MB.

With the advent of 1.5 Pro in May, Gemini Advanced gained document upload and data analysis (via spreadsheets) capabilities. However, it was only available using the web client.

We’re seeing mobile file uploads rolled out for Gemini Advanced subscribers on Android and iOS today.

5To9google

 

[Nairrk]

Google Calendar Extension in Gemini Now Rolling Out

Google announced that the Google Calendar extension is rolling out to Gemini. Announced earlier this year, the extension will allow users to manage and create calendar events. Google has now detailed how exactly the extension will work.

Google confirmed via a support page that, for now, the features related to Google Calendar in Gemini are available in English only. It is gradually releasing these features, so they might not be available for everyone just yet. Aside from that, Google noted that Gemini Apps work with events in your default calendar only, and the calendar-related features aren’t available in Gemini in Google Messages.

Then, to create and manage your Calendar events, you’ll need to connect Google Workspace to Gemini Apps. Once done, you can ask the Gemini app to create or show an event from Google Calendar. Gemini Apps can’t perform certain actions in Calendar, like:

• Create, ask for, or manage events that aren’t in your default calendar
• Add or invite people to events
• Add or update the location or description of an existing event

The Google Calendar extension in Gemini can, though, create events by giving specific details, create events based on your conversation, find events for a specific day or date range, find events based on event details, edit your events in Google Calendar except for the location or description of an event, and finally, cancel your events in Google Calendar.

Themobileindian

 

[Nairrk]

There's a new look on its way for Google Gemini

Google’s been hard at work over the past few months building its Gemini chatbot into a proper, full-featured evolution of Assistant. And while there’s still a lot of work to go there, Gemini’s already proven itself to be incredibly impressive, especially when it comes to advanced functionality like Gemini Live. Beyond just developing features, Google’s also been refining the way we access Gemini, and it looks like a fresh new look for the app is currently in testing for beta users.

We spotted these changes with version 15.38.46.29 beta of the Google app, and compared to the interface we’ve been using thus far, Gemini’s working to clean up its UI for a more clutter-free look. That involves dropping the suggestions up top, and hiding a lot of the rest of what we had behind the new icon in the top left. It’s there that you’ll tap to access your history of past chats. And below, Google’s giving us easy access to Gemini’s customizable Gems, for particularly tailored conversations with the chatbot.

The first sign of this new look arguably arrived via Gemini on the web, which features an interface largely similar to what the app’s experimenting with now — like the way the app personally addresses you to get started. We got our first peek at how this might look on Android just about a week back, and with access already available now to at least some users in beta, it doesn’t feel like it might be a huge wait longer before the same changes come to the stable build.

None of this is going to really impact our day-to-day usage of Gemini, but it still feels like a positive change, all the same — like Google trying a little less hard to “sell” us all on Gemini, and moving the app forward to a slightly more mature phase, with its interface focused less on discovery and more on usability.

Androidauthority

 

[Nairrk]

Gemini app rolling out ‘Make calls and send message without unlocking’

Google’s work on adding more basic features that make Gemini a good phone assistant continues today with the ability to place calls and send messages without unlocking your device.

In Gemini Settings > Gemini on Lock Screen, Google is rolling out a new “Make calls and send message without unlocking” setting.
Under an equally new “Outgoing calls and message” heading, the page explains how “You’ll need to turn on your calling and messaging apps in Gemini for these features to work.” At the end of October, Google started rolling out new Gemini Extensions for “Phone” and “Messages.”

Those Extensions are not yet widely available, but this new setting works without it by falling back to Assistant. On a device lacking this “without unlocking” preference, I have to “Please unlock to continue” (as depicted below).

With the new setting enabled, the call is immediately placed while my phone is still locked.

The “Make calls and send message without unlocking” setting is not yet widely available and still rolling out. (Try Force stopping the Google app.) We’re seeing it with Google app 15.48 beta after a server-side update.

9to5google