Review your AI spend and consumption

Learn how to connect AI apps, monitor token consumption and spend, and set budgets and alerts with AI Spend and Consumption Management in 1Password SaaS Manager.

AI Spend and Consumption Management in 1Password SaaS Manager gives you a centralized report of the cost and utilization of AI apps within your organization.

With AI Spend and Consumption Management, you can:

  • Monitor token consumption and spend across AI apps in a single dashboard.
  • Filter the reported usage by time period, AI app, team, and more.
  • Set budgets per AI app and track burn rate against your contractual commitments.
  • Configure alerts to receive notifications before a budget or prepaid balance runs out.
  • Review data for specific AI apps to see usage by team, cost center, model, product, account, and API key.
  • Manage API key names and assignments to teams and cost centers.

Connect your team’s AI apps

To see data about your team’s AI usage in SaaS Manager, make sure your teams in SaaS Manager are set up to match your organization’s structure by importing teams from your IdP or HR system or by setting them up manually. You should do this before you connect your team’s AI apps to make sure that AI usage data is assigned to the appropriate teams and cost centers.

After you make sure your teams are properly set up, follow the steps to turn on AI Consumption for at least one of the supported AI apps:

Note

If you’ve previously set up the integration for one of these AI apps, you may need to reconnect it with an API key with different permissions to start ingesting AI usage data.

After you connect an AI system, data will start to sync automatically and may take up to 24 hours to initially populate. Historical data may take a few days to fully collect.

Ongoing usage data will continue to sync on a daily basis. You can see the last time usage data synced on the Overview tab for the AI app integration.

Analyze your team’s AI consumption

To analyze your team’s AI consumption, select AI Consumption in the sidebar. The AI Consumption dashboard provides a chart that plots your organization’s AI usage and spend across all of your configured AI apps.

You can view your team’s consumption over time as an incremental or cumulative chart, grouped by AI app, team, person, cost center, model, or API key. You can also select Filters to limit the data shown in the chart, or select the name of an entry in the table below the chart to quickly apply a filter.

If you group consumption by AI app or team, you can expand the entries in the table below the chart to see additional data, like specific products for an AI app or team hierarchy.

To view more information about a specific AI app or person, select View details on an app entry or View person on person entry in the table. If you view the details for an AI app, you’ll see the app’s AI Consumption tab. Depending on the data the AI app provides, you’ll see additional options to group usage data, such as by team, cost center, model, product, account, or API key.

Manage API keys

If you connect an AI app that returns usage data for API keys, you can choose to assign keys to a team, a cost center, or both, rename them, or delete them from your reports. Any changes made to API keys are recorded in the audit log.

To manage your API keys, select View details for the AI app on the AI Consumption dashboard. In that app’s AI Consumption tab, group the chart by API key. You’ll then see the options to assign, rename, or delete keys in the entries below the chart.

If you change the team or cost center a key is assigned to, your usage data will be recalculated, so you may need to refresh your browser after a few moments to see the updates reflected. If you delete a key in SaaS Manager but not in the AI app itself, it will reappear the next time SaaS Manager syncs your usage data.

Configure budgets and alert thresholds

For AI app integrations that support AI Consumption, you can also set individual budgets for each app to track actual spend data against a target or contractual commitment.

To create a budget, select the Budgets tab from the AI Consumption dashboard, then select New budget. You must set budgets for each app individually, and each budget can be set for a maximum of one year. At this time, overlapping budgets aren’t supported, but you can both set future budgets and view past budgets.

After you set a budget, SaaS Manager calculates the projected total spend for the duration of the budget, which is based on the burn rate calculated from the start of the budget period to the current date.

You can also modify the alert thresholds for your budgets. By default, the warning and critical alert thresholds are set to 75% and 90% respectively. To change budget alert thresholds, navigate to Settings > Spend > AI Consumption > Budget thresholds.

To determine who receives budget alerts and data gap notifications, or to turn off these notifications, navigate to Settings > Notifications > AI Consumption budget alerts.

Note

Budget alert thresholds are global values, so if you update these values, alerts for all AI app integrations with a configured budget will also update.

Considerations

Note

AI usage data is calculated using the APIs provided directly by the AI app providers. SaaS Manager relies on AI app providers to supply data accurately and in a timely manner. We recommend using AI Spend and Consumption Management as a part of a larger budget monitoring system.

If a user in SaaS Manager belongs to multiple teams, their AI usage will be reported as part of each team, which may result in the presented spend totals across teams appearing higher than the spend for the app overall.

Team and cost center assignments for users in SaaS Manager are captured as a snapshot when you first set up an integration to record usage for an AI app. If you change a user’s team membership or cost center association, SaaS Manager won’t reflect the changes in any historical usage data. Only usage data moving forward will reflect the assignment changes.

If needed, you can restrict access to AI usage reports based on individual users to comply with legislation in your region. To do so, navigate to Settings > Spend > AI Consumption > Permissions, then turn on the option to restrict reports.



Published: