Connect with us

AI in Travel

8 Ways to Scale your Data Science Workloads

Published

on


Sponsored Content

 

 
8-Ways-to-Scale-Data-Science8-Ways-to-Scale-Data-Science
 

How much time do you spend fighting your tools instead of solving problems? Every data scientist has been there: downsampling a dataset because it won’t fit into memory or hacking together a way to let a business user interact with a machine learning model.

The ideal environment gets out of the way so you can focus on the analysis. This article covers eight practical methods in BigQuery designed to do exactly that, from using AI-powered agents to serving ML models straight from a spreadsheet.

 

1. Machine Learning in your Spreadsheets

 

 

Machine Learning in your SpreadsheetsMachine Learning in your Spreadsheets
BQML training and prediction from a Google Sheet

 

Many data conversations start and end in a spreadsheet. They’re familiar, easy to use, and great for collaboration. But what happens when your data is too big for a spreadsheet, or when you want to run a prediction without writing a bunch of code? Connected Sheets helps by letting you analyze billions of rows of BigQuery data from the Google Sheets interface. All calculations, charts, and pivot tables are powered by BigQuery behind the scenes.

Taking it a step further, you can also access models you’ve built with BigQuery Machine Learning (BQML). Imagine you have a BQML model that predicts housing prices. With Connected Sheets, a business user could open a Sheet, enter data for a new property (square footage, number of bedrooms, location), and a formula can call a BQML model to return a price estimate. No Python or API wrangling needed – just a Sheets formula calling a model. It’s a powerful way to expose machine learning to non-technical teams.

 

2. No Cost BigQuery Sandbox and Colab Notebooks

 

Getting started with enterprise data warehouses often involves friction, like setting up a billing account. The BigQuery Sandbox removes that barrier, letting you query up to 1 terabyte of data per month. No credit card required. It’s a great, no-cost way to start learning and experimenting with large-scale analytics.

As a data scientist, you can access your BigQuery Sandbox from a Colab notebook. With just a few lines of authentication code, you can run SQL queries right from a notebook and pull the results into a Python DataFrame for analysis. That same notebook environment can even act as an AI partner to help plan your analysis and write code.

 

3. Your AI-Powered Partner in Colab Notebooks

 

 

Your AI-Powered Partner in Colab NotebooksYour AI-Powered Partner in Colab Notebooks
Data Science Agent in a Colab Notebook (sequences shortened, results for illustrative purposes)

 

Colab notebooks are now an AI-first experience designed to speed up your workflow. You can generate code from natural language, get automatic error explanations, and chat with an assistant right alongside your code.

Colab notebooks also have a built-in Data Science Agent. Think of it as an ML expert you can collaborate with. Start with a dataset – like a local CSV or a BigQuery table – and a high level goal, like “build a model to predict customer churn”. The agent creates a plan with suggested steps (e.g. data cleaning, feature engineering, model training) and writes the code.

And you are always in control. The agent generates code directly in notebook cells, but doesn’t run anything on its own. You can review and edit each cell before deciding what to execute, or even ask the agent to rethink its approach and try different techniques.

 

4. Scale your Pandas Workflows with BigQuery DataFrames

 

Many data scientists live in notebooks and use pandas DataFrames for data manipulation. But there’s a well-known limit: all the data you process needs to fit into your machine’s memory. MemoryError exceptions are all too common, forcing you to downsample your data early on.

This is the exact problem BigQuery DataFrames solves. It provides a Python API intentionally similar to pandas. Instead of running locally, it translates your commands into SQL and executes them on the BigQuery engine. Meaning you can work with terabyte-scale datasets from your notebook, with a familiar API, and no worries about memory constraints. The same concept applies to model training, with a scikit-learn-like API that pushes model training to BigQuery ML.

 

5. Spark ML in BigQuery Studio Notebooks

 

 

Spark ML in BigQuery Studio NotebooksSpark ML in BigQuery Studio Notebooks
Sample Spark ML notebook in BigQuery Studio

 

Apache Spark is a useful tool from feature engineering to model training, but managing the infrastructure has always been a challenge. Serverless for Apache Spark lets you run Spark code, including jobs using libraries like XGBoost, PyTorch, and Transformers, without having to provision a cluster. You can develop interactively from a notebook directly within BigQuery, letting you focus on model development, while BigQuery handles the infrastructure.

You can use Serverless Spark to operate on the same data (and the same governance model) in your BigQuery warehouse.

 

6. Add External Context with Public Datasets

 

 

Add External Context with Public DatasetsAdd External Context with Public Datasets
Top 5 trending terms in the Los Angeles Area in early July 2025

 

Your first-party data tells you what happened, but can’t always explain why. To find that context, you can join your data with a large collection of public datasets available in BigQuery.

Imagine you’re a data scientist for a retail brand. You see a spike in sales for a raincoat in the Pacific Northwest. Was it your recent marketing campaign, or something else? By joining your sales data with the Google Trends dataset in BigQuery, you can quickly see if search queries for “waterproof jacket” also surged in the same region and period.

Or let’s say you’re planning a new store. You can use the Places Insights dataset to analyze traffic patterns and business density in potential neighborhoods, layering it on top of your customer information to choose the best location. These public datasets let you build richer models that account for real-world factors.

 

7. Geospatial Analytics at Scale

 

 

Geospatial Analytics at ScaleGeospatial Analytics at Scale
BigQuery Geo Viz map of a hurricane, using color to indicate radius and wind speed

 

Building location-aware features for a model can be complex, but BigQuery simplifies this by supporting a GEOGRAPHY data type and standard GIS functions within SQL. This lets you engineer spatial features right at the source. For example, if you are building a model to predict real estate prices, you could use a function like ST_DWithin to calculate the number of public transit stops within a one mile radius for each property. You can then use that value directly as input to your model.

You can take this further with Google Earth Engine integration, which brings petabytes of satellite imagery and environmental data into BigQuery. For that same real estate model, you could query Earth Engine’s data to add features like historical flood risk or even density of tree cover. This helps you build much richer models by augmenting your business data with planet-scale environmental information.

 

8. Make Sense of Log Data

 

Most people think of BigQuery for analytical data, but it’s also a powerful destination for operational data. You can route all of your Cloud Logging data to BigQuery, turning unstructured text logs into queryable resources. This allows you to run SQL across logs from all your services to diagnose issues, track performance, or analyze security events.

For a data scientist, this Cloud Logging data is a rich source to build predictions from. Imagine investigating a drop in user activity. After identifying an error message in the logs, you can use BigQuery Vector Search to find semantically similar logs, even if they don’t contain the exact same text. This could help reveal related issues, like “user token invalid” and “authentication failed”, that are part of the same root cause. You could then use this labeled data to train an anomaly detection model that flags patterns proactively.

 

Conclusion

 

Hopefully, these examples spark some new ideas for your next project. From scaling pandas DataFrames to feature engineering with geography data, the goal is to help you work at scale with familiar tools.

Ready to give one a shot? You can start exploring at no cost today in the BigQuery Sandbox!

Author: Jeff Nelson, Developer Relations Engineer

 
 



Source link

Continue Reading
Click to comment

You must be logged in to post a comment Login

Leave a Reply

AI in Travel

STB, OpenAI ink MOU to drive advanced AI adoption across tourism sector

Published

on


[SINGAPORE] The Singapore Tourism Board (STB) has inked a memorandum of understanding with ChatGPT-maker OpenAI to drive the adoption of advanced artificial intelligence (AI) across the city-state’s tourism sector.

Going beyond traditional AI systems, advanced AI can perform complex cognitive tasks and generate human-like responses – by using machine learning generative capabilities to do things like understand natural language, analyse data at scale and create personalised, context-dependent solutions.

The collaboration will prepare STB and Singapore’s tourism sector for an AI-driven future and lay the groundwork for the sector to benefit from the latest AI advancements, the board said on Wednesday (Jul 23).

This aligns with STB’s Tourism 2040 roadmap – which prioritises developing a future-ready tourism sector – as it will prepare the sector for evolving technological advancements and transformative changes in the travel industry.

Jordan Tan, STB chief technology officer, said: “We see tremendous potential in this collaboration with OpenAI to drive innovation and agility in the tourism sector. By leveraging OpenAI’s capabilities, we envision AI as a key enabler in addressing productivity challenges and accelerating digital transformation across the sector.”

Speaking on the partnership, Oliver Jay, managing director of international at OpenAI, said the company would support STB in integrating its technology across multiple applications.

BT in your inbox

Start and end each day with the latest news stories and analyses delivered straight to your inbox.

Improving visitor experience

Under the tie-up, STB will adopt OpenAI’s technology and explore potential use cases where advanced tools and robotics can be incorporated into tourism.

STB will evaluate the impact of such use cases, explore their scalability and potentially launch trials with relevant sector partners.

The board will use OpenAI’s capabilities to enhance visitor experiences through greater personalisation and engagement, as well as to improve organisational and industry productivity.

This could involve working with tourism businesses, such as hotels and attractions, to provide tailored recommendations and multilingual assistance, STB said. It may also include delivering immersive storytelling initiatives that create memorable experiences.

“These initiatives will ultimately encourage repeat visits and (serve as) advocacy for Singapore,” the STB said.

Moreover, the use of advanced AI will help deepen insights, refine destination marketing and product strategies, and support industry stakeholders in creating responsive services, the board added.

OpenAI was founded in 2015 by a group including its CEO Sam Altman and Elon Musk, the world’s richest person. However, Musk has since left the firm.



Source link

Continue Reading

AI in Travel

STB, OpenAI ink MoU to accelerate AI adoption for tourism sector

Published

on


Singapore – The Singapore Tourism Board (STB) and OpenAI have inked a memorandum of understanding to accelerate Advanced AI adoption across the country’s tourism sector. The move marks the first MoU between a national tourism organisation in Asia and OpenAI, reflecting Singapore’s commitment to innovation.

The collaboration will see STB leveraging OpenAI’s capabilities to enhance travellers’ experiences while improving the organisation’s operations. 

Using Advanced AI, STB is looking to unlock insights to redefine destination marketing and its product strategies. Its efforts will include delivering tailored recommendations, multilingual assistance, and immersive storytelling.

Through the MoU, STB will incorporate tools and robotics, exploring potential use cases and scalability within the tourism sector.

OpenAI’s technology is expected to drive STB’s AI-powered future, setting the sector’s journey towards incorporating the latest technological advancements.

Jordan Tan, chief technology officer at Singapore Tourism Board, said, “We see tremendous potential in this collaboration with OpenAI to drive innovation and agility in the tourism sector. By leveraging OpenAI’s capabilities, we envision AI as a key enabler in addressing productivity challenges and accelerating digital transformation across the sector.”

“This collaboration aligns with our Tourism 2040 roadmap to prepare the industry for evolving technological advancements, laying the foundation for transformative changes in the travel industry. From helping businesses boost operational efficiency to enhancing visitor experience through greater personalisation and engagement, these initiatives will ultimately encourage repeat visits and advocacy for Singapore,” Tan added.

Oliver Jay, managing director of international at OpenAI, said, “Singapore has consistently set global standards in innovation, and we are proud to support STB’s commitment to shaping the future of tourism through AI. By integrating OpenAI’s technology across multiple applications, we look forward to helping STB redefine visitor experiences at scale and drive new standards of excellence within the global tourism industry.”



Source link

Continue Reading

AI in Travel

How AI is transforming travel safety for real people

Published

on


For decades, travel risk management focused on the map, flagging “high-risk” destinations based on war zones, civil unrest or health crises. But the map doesn’t tell the whole story. Risk isn’t just about where you go; it’s also about who you are.

Most traditional travel risk models are built around a generic traveler profile: a businessperson, a tourist, a woman. But people aren’t personas; they’re layered and complex—and so are their risks.

A solo female traveler, for example, isn’t defined just by her gender. She might be a young LGBTQ consultant traveling to the United Arab Emirates, where her identity exposes her to elevated risks. A frequent-flying executive might also be managing an invisible health condition. A tech contractor traveling to Israel on an Iranian passport faces an entirely different risk profile than their British colleague on the same trip.

These risks don’t show up on traditional heat maps, but they are real, deeply personal and potentially life-threatening. Where people are going still matters, but who they are is what truly defines their risk. It’s this personal context that shapes their vulnerabilities. This is where AI comes in, not as a gimmick but as a critical tool in reshaping how we assess and manage travel safety.

From reading to predicting and personalizing risk

The old model waited until something happened, sending out a travel alert after an incident: “There’s been an attack in Paris.” Helpful? Maybe. But today, artificial intelligence (AI) is changing the game.

By analyzing real-time data streams, from news and social media to travel patterns, AI can now anticipate disruptions and alert travelers before they’re caught in the chaos. Tomorrow’s approach sounds more like: “Unrest is likely next week in this district. Let’s adjust your itinerary before things escalate.”

Even more powerful is AI’s ability to personalize those alerts. Not everyone faces the same risks. A city marked “low risk” for the average traveler might still be dangerous for someone who is trans, part of a religious minority or carrying identity markers that could draw unwanted attention at borders or during interactions with local authorities.

Instead of sending generic warnings, AI tools can deliver encrypted, discreet messages tailored to a traveler’s unique profile, destination and situation. These alerts are personalized, relevant and, most importantly, private. This shift from reaction to prediction to personalization is where AI truly proves its value.

AI doesn’t work alone

Let’s be clear: AI isn’t flawless. It can process vast amounts of data and identify risk patterns, but it doesn’t experience fear or understand what safety feels like to you. It might flag a district with a higher incident rate at night, but it can’t sense the quiet unease a lone traveler might feel while walking through it. It struggles to interpret cultural nuances or the subtle signals that make a place feel welcoming, or not.

AI also can’t function without data, and that’s where things get sensitive.

Its effectiveness hinges on access to detailed traveler profiles, including data points like nationality, gender identity, health conditions and sexual orientation. This is deeply personal information. Building smarter systems must never come at the expense of privacy.

The question is: How do we protect traveler data while delivering tailored safety? Some companies are now exploring secure digital travel wallets, tools that store identity data locally, keeping it encrypted and accessible only to vetted systems.

Integrating AI into travel risk management must go hand in hand with ethical data governance, transparency and traveler control. If travelers don’t trust the system, they won’t use it, and that leads to a safety failure.

As AI takes over the tactical side of risk management, the role of travel managers is evolving. They are becoming decision-makers, advocates and the human judgment that AI can’t replicate. Their job now is to step in when the system falls short.

The silo problem

Despite AI’s promise, its full potential is still being held back by a persistent issue: fragmentation. Travel managers, suppliers, tech platforms and insurers each hold pieces of the safety puzzle, but too often, they operate in isolation. When systems don’t communicate, people fall through the cracks.

Take the case of a British traveler flying into Mexico City. AI flags a potential threat near their hotel, but the itinerary management system doesn’t recognize it. The company’s policy doesn’t allow last-minute hotel changes. The result? The traveler is stuck. Not because the data was wrong, but because the system wasn’t aligned.

Time for leadership

AI is already reshaping how we think about travel risk, but only if we use it boldly and responsibly. In the United States, for example, 82% of companies used AI to manage business travel in 2024, up from 69% in 2023. Strong leadership is essential to ensure AI is applied equitably and effectively.

That means investing not just in technology but in the ecosystems that support it: data governance, traveler education, human oversight and ethical policies.

Travelers don’t need more alerts. They need better ones: smart, timely and relevant. It’s not just about identifying risks; it’s about understanding who is at risk. The companies that embrace this shift won’t just reduce risk. They’ll build trust, protect their people and lead the future of travel.

Because in the end, this isn’t just about AI. It’s about real people facing real risks, finally being seen for who they are.

About the author…

Suzanne Sangiovese is the CEO at Riskline.



Source link

Continue Reading

Trending

Copyright © 2025 AISTORIZ. For enquiries email at prompt@travelstoriz.com