Monthly Fabric Updates Blog summaries, grouped by workload.
Fabric Git integration now supports GitHub Enterprise Cloud with data residency (ghe.com), enabling organizations to store GitHub Enterprise data within specific geographic boundaries for compliance.
Automatically move historical data to cost-effective tiers via lifecycle policies based on creation, modification, or access time.
Workspace admins get item-level visibility into OneLake storage usage, including system and soft-deleted data, in a single report.
Materialized lake views can now reference source tables and upstream views across lakehouses and workspaces; Fabric resolves dependencies and refreshes in order.
Custom authorization logic for GraphQL APIs that evaluates each authenticated request before processing.
Fabric AI Functions default to gpt-5-mini with low reasoning; gpt-4.1 series retiring. Simplified PySpark chaining, df.ai.stats for token usage, and pandas no longer requires openai-python.
Authenticate and run Fabric Data Agents via app identities instead of delegated user credentials, enabling secure backend and automation scenarios.
Fabric data agents now surface in Foundry Observability with detailed telemetry — latency, status, and error details per call.
Publish Fabric data agents as declarative agents in M365 Copilot, with improved support for longer-running, complex queries.
AI-assisted setup that generates and refines data agent configurations through an interactive workflow for SQL and Eventhouse sources.
Opt in to a preview Data Agent runtime for early access to improvements like enhanced NL2SQL and higher query result limits.
New NL2SQL toolset with better accuracy, transparency, clarifying questions, and smarter filter mapping across Lakehouses, Warehouses, and Mirrored Databases.
The orchestrator routes ambiguous or multi-source queries more accurately across SQL and KQL sources using schema, examples, and source descriptions.
Code Interpreter lets the Fabric Data Agent run Python for statistical analysis, forecasting, and rich visualizations directly within agent workflows.
GPU-powered execution in the data warehouse enables responsive, concurrent analytical queries for AI workloads and agentic experiences.
Manage SQL Analytics Endpoint as DacFx database projects in Git and deploy incremental schema changes through Fabric Deployment Pipelines.
Run controlled SQL actions before and after Warehouse deployments to validate, prepare, finalize, or clean up as part of CI/CD.
Change column length, precision, and scale on existing tables via standard T-SQL with no data rewrite.
Single place to monitor running and historical queries with per-query metrics (CPU, data scanned, cache) — including the ability to cancel runaway queries.
30-second data freshness SLO for SQL analytics endpoint, enabled via workspace setting.
Configure data retention from 1 to 120 days, replacing the fixed 30-day window.
Query Lakehouse data via SQL analytics endpoint as it looked at any prior point in time using OPTION (FOR TIMESTAMP AS OF ...).
Stream Delta Change Data Feed row-level changes from Mirrored Databases directly into Fabric Eventstreams for event-driven processing.
Redesigned AI-first tile editor for Real-Time Dashboards — describe visuals in natural language, with chat history and seamless switch to manual KQL editing.
Dedicated time series capabilities for Real-Time Dashboards: legend search, group navigation, series pinning, multi-panel comparison, flexible Y-axis scaling, and crosshair.
Generate shareable links for Copilot-driven exploration results, including the visual, so recipients can run, modify, share, or save the query.
Event-driven refresh model that refreshes visuals when new data arrives — pausing available — for fresher data without constant polling costs.
Workspace Monitoring auto-creates EventStreamNodeStatus, EventStreamMetrics, and EventStreamErrorMetrics tables, queryable in KQL.
Eventstream transforms raw signals (CDC rows, telemetry) into structured Business Events via filtering, enrichment, and correlation.
Activator can publish structured, governed Business Events when conditions are detected across Power BI, Real-Time Dashboards, KQL, or Warehouse queries.
Business Events are automatically stored in Eventhouse and ready to query via KQL — no extra pipelines required.
Transparent consumption-based model with per-event operations and per-hour event listener charges, visible via the Fabric Capacity Metrics app.
Allowlist Azure Event Grid system topics as trusted resources via Resource Instance Rules to receive Azure events while keeping strict network boundaries.
Workspace OAP support for Azure and Fabric events, with cross-workspace consumption gated by data connection rules.
Bring your own CA and client certificates from Azure Key Vault to securely connect to MQTT brokers with mTLS.
New Kafka Connect-based IoT Hub source preserves all system and user metadata properties for downstream analytics.
Kafka connector adds SASL_SSL and Custom CA/mTLS; Azure Service Bus connector is GA for production messaging workloads.
HTTP connector supports page-based and cursor-based pagination to ingest paginated REST API data without custom orchestration.
Open-source SDK and CLI for building application backends on Fabric, with built-in database, authentication, frontend hosting, and Semantic Model integration.
Native CDC support in Copy job for Azure SQL Database, SQL Server, and Azure SQL MI — replicating inserts, updates, and deletes without custom logic.
Native SCD Type 2 in Copy job — including soft delete handling — now extended to Fabric Warehouse destinations.
Auto Partitioning extended to Oracle, Fabric Lakehouse, and SAP HANA for higher throughput without manual tuning.
Programmatically define and bulk-update Copy job configurations through JSON-based editing.
Microsoft-built ABAP Add-On enables advanced SAP data extraction beyond standard APIs, with flexible table and column mapping.
New Approval activity adds human-in-the-loop decision points to pipelines for business approvals, validation checkpoints, and exception handling.
Trigger refresh of materialized lake views from pipelines, with Fabric automatically choosing full, incremental, or no refresh.
Reliable activity to refresh the SQL analytics endpoint as part of pipeline workflows.
Redesigned pipeline canvas with improved visibility, cleaner layout, and a more responsive canvas for large, complex pipelines.
Define retry logic by error code, error message, or both with AND/OR logic for fine-grained activity recovery.
New Variable Library types for connections and items let pipelines dynamically bind to external connections and Fabric resources at runtime.
Fabric Airflow jobs now reference Variable Libraries for environment-specific configuration with multiple value sets per workspace.
Secret-less, managed authentication to SharePoint via workspace identity for Power BI Service and Dataflows Gen2.
Snowflake connector in Power Query supports secret-less authentication using Microsoft Entra ID backed by Fabric workspace identity.
After months of preview feedback, iteration, and performance tuning, both capabilities are now fully supported and available to all Fabric users.
Use AI to instantly generate clear, meaningful descriptions for semantic models, making it easier for teams to discover relevant data and choose the right assets.
The IBM Netezza ODBC driver is now Generally Available; the previously built-in driver is being deprecated. Customers should install the new ODBC driver soon to ensure a smooth transition.
Fabric Notebook supports a retry policy so notebook jobs automatically restart after system errors (e.g. Spark cluster recycle), with no manual intervention.
The Fabric Data Engineering VS Code extension lets you manage multiple Fabric workspaces and their items in one VS Code window, with edits synced back to the remote workspace.
View and edit Spark Environment items as YAML directly in VS Code via Inspect/Edit Environment actions on the Environment node.
Add, remove, and set the default Lakehouse for a notebook from VS Code — changes sync automatically to the remote workspace.
Fabric Environment supports adding libraries from Maven repositories, letting Scala and Java developers manage libraries and transitive dependencies via standard pom.xml configurations.
ML Experiments and Models can now be created and managed in workspaces with Outbound Access Protection (OAP) enabled, unblocking data science teams in security-sensitive environments.
Fabric supports cross-workspace MLflow logging for experiments and models, enabling end-to-end MLOps workflows from dev to test to production using standard MLflow APIs.
SemPy 0.14.0 introduces sempy.fabric.admin with 75 admin APIs covering workspaces, capacities, domains, tenant settings, reports, and users — all directly from Python.
Supported ALTER TABLE operations can now run within a user-defined transaction (BEGIN TRAN … COMMIT) in Fabric Data Warehouse, alongside other DDL and DML operations.
Ingest newline-delimited JSON (JSONL) files directly into Fabric Data Warehouse tables using the existing COPY INTO surface area.
Stream Delta Change Data Feed (CDF) row-level changes from Mirrored Databases directly into Fabric Eventstreams for low-latency, event-driven scenarios.
Fabric Eventstream integrates with Workspace Monitoring, giving you queryable observability into your streaming pipelines.
Enables AI agents to securely query and analyze real-time data in Eventhouse using natural language and KQL via a hosted remote MCP server — nothing to install.
Add or delete columns on Eventhouse OneLake delta tables as your data evolves, without breaking downstream consumers.
Eventstream now supports creating and managing Activator rules directly within the Eventstream experience.
Eventstream connectors support custom certificate authorities and mutual TLS, enabling secure integration with sources requiring enterprise PKI.
In today's data-driven world, effective data governance is crucial to ensure the integrity, security, and usability of data. OneLake catalog is available for Fabric admins, providing tools and insights to govern and secure data estates…
OneLake Catalog's Search API brings cross-workspace discovery to code. Instead of traversing workspace-by-workspace and "listing everything," a single search request can locate matching items across your accessibl
Fabric tags add meaningful metadata so people can find the right content faster and organize it consistently. That capability is available for workspaces. Workspace tags add shared context (like team, project, or cost center) at the…
When handling sensitive data, it might be challenging to find the right balance between federating data and keeping it secure and compliant. Data Loss Prevention (DLP) policies enable organizations to detect sensitive data and surface…
Microsoft Purview Insider Risk Management cross-references millions of signals across all your products, to create comprehensive profiles of potentially unethical behavior inside your organization.
A new quick policy for the Data Theft rule is available for Fabric. This streamlined experience makes it easier to set up protection against data exfiltration scenarios, helping security teams take action faster when sensitive Fabric…
The Microsoft Purview Insider Risk Management pay-as-you-go feature usage report is designed to provide transparency to customers, enabling more accurate budget planning and policy tuning. IRM admins can check the distribution of PAYG…
As AI adoption accelerates, organizations need built-in protections to keep data safe. With Purview Data Security Posture Management (DSPM) for AI, customers gain visibility and control over AI interactions. DSPM for AI helps teams spot…
Branched workspace is a new developer experience designed to simplify how teams work with feature workspaces during a branch-out flow. With clearer visual cues and richer context, developers can easily understand workspace relationships…
Fabric Git Integration Branch-out with selective branching introduces a more focused branch-out experience in Fabric. Developers can select only the items they need for a feature, reducing clutter in the target workspace, improving…
The new compare code changes experience helps developers confidently sync their Fabric workspace with a connected Git branch by clearly showing what changed before taking action. It provides a familiar code-compare experience that…
The new connection reference item type in Variable Library introduces a new way to manage external data connections in Microsoft Fabric. This new variable type lets you reference existing connections—such as Azure SQL or Snowflake—by…
These APIs enable you to programmatically export, import, and synchronize Fabric item definitions across workspaces at scale—all through the Fabric REST API.
The Fabric CLI v1.5 is the most scenario-driven update yet. Power BI developers can now trigger semantic model refreshes, rebind reports, and script end-to-end deployment workflows—all from the terminal, without portal context-switching.
A new deploy command integrates the Fabric CI/CD Python library directly into the Fabric CLI, enabling full workspace deployments—including item rebinding and configuration—from a single command. Teams can run deployments from their…
Fabric CLI is designed to work well with AI agents. A structured agent instructions file and a dedicated Fabric CLI Skill provide AI assistants like GitHub Copilot and Claude with the context they need to generate correct CLI commands…
Fabric Remote MCP is a cloud-hosted MCP server that allows AI agents to perform real operations in your Fabric environment—create workspaces, manage permissions, work with item definitions, and more. No local installation is required.…
The Fabric Local MCP is an open-source MCP server that runs on your machine. This solution integrates AI coding assistants with the comprehensive Fabric API, offering OpenAPI specifications, best-practice guidelines, item definition…
After six months in preview mode, gathering feedback, resolving bugs, and strengthening the platform, we've reached the next milestone. Partners and customers can build, validate, and publish custom Fabric workloads to production with…
Three new features further enhance the professional development experience for Fabric workloads.
As the Fabric extensibility ecosystem grows, with partners publishing workloads and organizations building custom solutions, managing workloads at scale demands more than a single settings page. IT admins need centralized governance and…
The Fabric Admin Portal now includes a dedicated Manage Workloads tab, a single pane of glass for workload governance across your organization.
A frequent question from ISV partners using the Microsoft Fabric Extensibility Toolkit is: "How do I get started publishing?"
This month, we announced third-party support for OneLake security, taking an important step toward interoperable data security. As customers increasingly build lake-first architectures on open formats like Delta and Iceberg, they expect…
You can easily access and organize all your OneLake data from Windows using the OneLake file explorer. The file explorer lets you browse every workspace and data asset, and upload, download, or edit these files using the same familiar…
Fabric Runtime 2.0 (Preview) is a next-generation runtime that is purpose-built for large-scale data computations in Microsoft Fabric and introduces key features and components that enable scalable analytics and advanced workloads.…
Modern data engineering workloads are rarely one-size-fits-all. Teams often need predictable performance, isolated resources, or customized configurations for critical production pipelines and high-value interactive development.
As organizations scale their Fabric usage, understanding what's running, what's queued, and why becomes essential.
Modern data engineering teams shouldn't need to be Spark experts to get great performance. With Resource Profiles in Fabric Data Engineering, users simply describe what they're trying to do, and Fabric automatically recommends the…
Managing libraries shouldn't slow down your development workflow. In Microsoft Fabric Environments, we're introducing a more efficient way to iterate on libraries while keeping production workloads stable and reliable.
Fabric High Concurrency Spark sessions enable both interactive exploration and large-scale, pipeline-driven notebook execution, supporting parallel, scheduled, and event-driven workloads at enterprise scale.
With data export settings for notebooks, Microsoft Fabric empowers administrators with explicit, tenant-level control over how data leaves notebooks. This feature helps ensure that interactive analytics do not inadvertently become…
Fast session startup is critical for interactive analytics, and Fabric's Starter Pools are designed to deliver Spark sessions in ~5 seconds by default. However, when that target isn't met, users have historically had little visibility…
With the Native Execution Engine, Fabric Data Engineering continues to raise the bar on price-performance leadership for large-scale analytics. Beyond execution-time optimizations, the engine now includes native support for Z-Order and…
Microsoft Fabric notebooks now include a context-aware Copilot experience designed to support you across the full notebook lifecycle. By automatically understanding your workspace environment—including attached Lakehouses, notebook…
The Fabric notebook custom agent is a Fabric-native AI development agent embedded in the Fabric Data Engineering VS Code extension. It helps data engineers build, debug, and publish Microsoft Fabric notebooks and Spark workloads. Unlike…
ISV and partners often collaborate with multiple end customers, each typically operating within their own dedicated Microsoft Fabric tenant. To address this need for flexibility, the Fabric Data Engineering VS Code extension now enables…
Users can now run Fabric notebooks within VS Code using a variety of new kernels. Previously, running notebooks required users to specify the language of each cell using cell magic commands and rely on PySpark as the execution…
MLVs now support multiple named schedules per lakehouse. Previously, all MLVs shared a single schedule, and teams needing different refresh timings resorted to notebook-triggered refreshes. This workaround bypasses dependency…
MLVs now support PySpark authoring (Preview), letting data engineers create, refresh, and replace MLVs from Fabric notebooks using the DataFrameWriter API. Previously, teams wrote definitions in Spark SQL, which made custom cleansing…
Getting data into your Lakehouse should be straightforward. For many customers, the first interaction with Microsoft Fabric begins right after creating a Lakehouse and selecting Get data. With this update, Copy job appears at the top of…
Fabric notebooks now support lakehouse auto-binding when used with Git flow, making notebooks more portable across environments such as dev, test, and prod. Instead of hard-binding a notebook to a specific lakehouse in the original…
Notebook projects often depend on more than just notebook code—such as reusable Python modules, configuration files, or small supporting assets. Fabric notebooks now support committing the built-in Resources folder to Git, enabling true…
Fabric Notebook Public APIs enable notebooks to be managed and executed programmatically as first-class assets. The APIs provide full CRUD support—enabling teams to create, update, list, and delete notebooks at scale—making them ideal…
We're introducing upgraded Copilot completion in Fabric notebooks to deliver a faster, more accurate, and more intuitive coding experience. With this update, auto-completion is closer to what developers expect from VS Code-style inline…
Fabric notebooks now let you create and manage files directly in the built-in Resources folder, making it easier to develop and maintain notebook dependencies. You can create and edit Python modules, configuration files, and other…
Data sources: Build and consume data agents on a broad set of data sources, including Lakehouse, Warehouse, semantic models, Eventhouse, SQL databases, and mirrored databases. - Configurations: Configure data agents using agent-level…
Workspace Apps (Apps V2) are now supported in the OneLake Catalog, so you can discover, browse, and open apps directly from the Insights category. This category focuses on business-ready content designed to help you analyze, visualize, and report on data to…
The updated Item Details experience now extends beyond the OneLake Catalog to include full-page experiences for items accessed from outside the catalog. For example, when you open a Semantic Model directly from Workspaces, you will now see a modern, unified…
Fabric Identity governance at scale just got easier. We are introducing a new tenant admin setting that gives you control over the maximum number of Fabric identities (hence Workspace identities) in your organization.
To give developers more control over how they navigate open items in Microsoft Fabric, we’ve introduced new horizontal tab display settings. These settings let you tailor how tabs appear across the top of the Fabric interface—helping you stay organized and …
Keeping track of how a notebook evolves gets tricky when changes can come from different entry points—editing in the Fabric portal, syncing from source control, or other update flows. Fabric notebooks seamlessly integrate with Git, deployment pipelines, and…
Python developers often want to keep notebooks modular—shared utilities, setup logic, and reusable helpers shouldn’t be copy‑pasted everywhere. Python notebooks now support %run, enabling a familiar pattern for executing shared “code modules” and reusing lo…
Full-size mode of cells is now available on Fabric notebook. When you’re working on a long or complex cell, the surrounding UI can get in the way. Full Size Mode lets you expand a single cell to fill the notebook for distraction‑free editing—ideal for deep …
To enable private link, update your tenant admin settings to enable Azure private link.
With this release, we have made improvements to reliability and performance on of the experience with Fabric CI/CD and deployment pipelines experience. Your teams can manage GraphQL artifacts in Git, collaborate with familiar pull-request workflows, and pro…
Fabric User data functions now support default argument values, allowing omitted arguments to use preset defaults, which simplifies function calls and enhances code flexibility. This feature supports various input types including strings, boolean, floats, i…
ODBC (Open Database Connectivity) is a widely adopted industry standard that enables applications to connect to and work with data across databases and big data platforms. Today, we’re introducing the Microsoft ODBC Driver for Microsoft Fabric Data Engineer…
Enterprise teams can now run Microsoft Fabric Notebooks in CMK‑enabled workspaces with Notebook content and metadata encrypted at rest using customer‑owned keys in Azure Key Vault, supporting stricter governance and compliance requirements without changing …
With the 0.13.0 release, Semantic Link continues to expand its Fabric coverage and management capabilities. This update introduces new modules for lakehouse, reports, semantic models, SQL endpoints, and Spark, enabling end‑to‑end workspace operations—from c…
The new monitoring experience for real‑time scoring endpoints in Microsoft Fabric provides clear visibility into request volume, error rates, and latency as models run in production. Teams can easily compare these metrics across endpoint versions to validat…
The export option is available directly from the Migration Assistant’s summary view and full screen view.
Understanding why workloads slow down often require visibility beyond individual queries. SQL Pool Insights extends the existing Query Insights experience with pool‑level telemetry, helping you understand how resources are allocated and when pools are under…
Connecting data is often the first step on a user’s Real-Time Intelligence journey—and it should be effortless.
Real-Time Intelligence Eventstream is designed to bring real-time data from diverse sources, transform it, and effortlessly route it to various destinations. For sources that run in private network environments ~~,~~ such as cloud virtual network or on-prem…
Based directly on community feedback, we’ve optimized the Real-Time Dashboard from the ground up, ensuring a snappier, high-performance experience.
When you work with the same data sources repeatedly in Dataflow Gen2, the new Recent data (Preview) module helps you access your most frequently used data faster.
In September 2025, we released a preview of the Fabric variable libraries integration with Dataflow Gen2. This update address two of the most common feedback themes:
One of the core principles of Fabric and Data Factory is enabling solutions that are CI/CD-ready. In Dataflow Gen2, you can already use public parameters and Fabric variable libraries to make your solutions dynamic and compatible across deployment pipelines.
Previously, Dataflow Gen2 required you to manually trigger a publishing operation before running or refreshing a dataflow whenever unpublished changes were present.
The Modern Query Evaluation Engine (Modern Evaluator) for Dataflow Gen2 brings substantial performance and reliability improvements to data transformation workloads across Microsoft Fabric.
When performing incremental copy from a Fabric Lakehouse table, we strongly recommend using CDF (Delta Change Data Feed) to capture row inserts, updates, and deletions, and replicate them to supported destinations.
Previously, you could use SAP Datasphere Outbound for ADLS Gen2 in Copy job to perform CDC replication from SAP to any supported destination. For more details, see Tutorial: Copy job with SAP Datasphere Outbound (Preview).
Column mapping from source to destination is now supported during CDC replication within the Copy job. This is useful when you want to rename columns, change data types, or otherwise customize the schema in the destination store.
Copy job simplifies data movement from many sources to many destinations by natively supporting multiple delivery styles, including bulk copy, incremental copy, and change data capture (CDC) replication. For incremental copy, the first run performs a full c…
We are expanding authentication support in the Copy job activity in pipeline, making it easier than ever to securely connect, integrate, and move data across a broad range of enterprise and SaaS systems. This enhancement reflects our continued commitment to…
As we continue improving ingestion performance, we’ve introduced a new enhancement for reading CSV datasets in Data Factory. It significantly boosts ingestion throughput for large CSV files—a common customer challenge when a single file can’t fully take adv…
Adaptive Performance Tuning is designed to intelligently optimize data movement performance based on your configuration and runtime context. This feature represents a major step forward in making performance tuning simpler, safer, and more effective without…
The Auto-Summary for semantic models is an AI-generated high-level summary that helps you quickly understand an item’s purpose and main characteristics without opening the item or reviewing its full metadata. It makes it easier to understand unfamiliar item…
OneLake catalog now includes a clear Parent–Child item structure that makes it easier to understand how your data items relate to each other. Instead of showing everything in one flat list, the catalog now groups connected items together and displays them i…
The Variable Library in Microsoft Fabric continues to evolve, and one of the most impactful additions arriving with the upcoming release is the Item Reference variable type, a new way to reference Fabric items in a structured, resilient, and more secure way.
Fabric workspaces can now connect to GitHub Enterprise Cloud instances with data residency (ghe.com), allowing regulated customers to use Microsoft Fabric – Git Integration.
We have introduced a highly requested flexibility feature that allows users to create a new branch from their last synchronization point and commit current changes to it in a single action.
Python SDK is now available on PyPI as microsoft-fabric-api and you can get started today.
Microsoft Fabric is introducing new granular REST APIs for security role management, giving developers finer control over how OneLake permissions are created, retrieved, and managed programmatically. In addition to the existing batch role API, Fabric now su…
Microsoft Fabric now supports defining OneLake data access roles on all mirrored item types, extending granular, role-based security to data replicated into OneLake from transactional systems. With this update, customers can control access to mirrored data …
OneLake diagnostic events can now be made immutable, which means that the JSON files that contain diagnostic events can't be tampered with, or deleted, during the immutability retention period.
High Concurrency mode for Lakehouse operations in Microsoft Fabric is a new capability designed to dramatically optimize Spark resource utilization for common tasks like Load to Table and Preview.
With this update, notebooks now offer the familiar Get Data feature, making it simpler and safer for users to access data from frequently used sources like Azure Blob Storage, PostgreSQL, Azure Key Vault, and S3.
Users can now directly open and edit the Fabric Notebook within its VS Code editor. Previously, the Fabric Data Engineering VS Code extension enabled notebook development in VS Code only after downloading the notebook. With this update, the notebook can be …
Materialized Lake Views now support create or replace semantics, making it significantly easier to evolve data models as business requirements change. This enhancement allows users to update an existing Materialized Lake View—whether that involves adding or…
Lineage for materialized lake views now clearly shows the Notebook Source, making it simple to trace each view to its origin. Deleted sources are also flagged for quicker troubleshooting and more reliable refresh scheduling.
Proactive statistics Refresh for the Data Warehouse and Lakehouse SQL Analytics Endpoint is a built-in optimization that enriches the automatic management of vital column statistics. With this feature enabled, column statistics that were created during SELE…
Incremental statistics refresh is a performance enhancement in Data Warehouse and Lakehouse SQL Analytics Endpoint that improves the execution time of certain column statistic updates. Columns in long tables that experience mostly INSERT or ADD operations s…
In 2025, we introduced result set caching (Preview) for Data Warehouse and Lakehouse SQL Analytics Endpoint. This feature expedites repetitive queries by quickly returning cached results instead of recomputing original queries from scratch. Out-of-the-box p…
In September 2025, the MERGE statement was released for preview in Data Warehouse. This command provides a standardized approach to transforming your data by incorporating conditional logic and DML actions all within a single statement.
We now support MQTT v3 in the Eventstream MQTT Connector, making it compatible with widely used industry protocols.
Bring production-ready weather data streaming to your Fabric for real-time analytics. As part of this release, we’ve added several key enhancements based on early user feedback. You can now include a location name directly in the event payload, making proce…
Accelerated OneLake shortcuts in Eventhouse indexes and caches data in OneLake, allowing performant queries on top of delta/Iceberg tables in OneLake. By default, the system uses the modificationTime in delta\_log to determine the scope of data to accelerate.
MaxAge property in query acceleration policy controls the data freshness. The shortcut returns accelerated data if the last index refresh time is greater than @now - MaxAge. Otherwise, the shortcut operates in non-accelerated mode. The default for MaxAge is…
Eventhouse shortcuts can now be queried just like Tables, eliminating the need for explicit external\_table() syntax, making queries cleaner and more intuitive. This simplifies external data access by allowing direct querying of external tables using standa…
Copilot in KQL Queryset and Real-Time Dashboards can now generate KQL for shortcuts.
We are expanding Copy job with broader multi‑cloud connectivity and stronger incremental copy support. Incremental copy in Copy job now supports additional connectors, including:
In today’s data-driven world, effective data governance is crucial for ensuring the integrity, security, and usability of data. The governance experience for Fabric admins within the OneLake catalog is being extended. With this experience we’re empowering F…
A new right-click menu has been implemented for horizontal tabs, enhancing the efficiency of tab management.
This highly anticipated feature empowers Fabric customers to achieve a comprehensive set of automation processes.
OneLake diagnostics, makes it simple to answer ‘who accessed what, when, and how’ across your Fabric workspaces. This enables federated data governance, operational transparency, and compliance reporting on a scale. Because events are stored in your Lakehou…
OneLake security now supports ReadWrite access controls, giving data owners the ability to define precise permissions for how users can write to data in lakehouses. This enhancement allows teams to assign ReadWrite access to workspace Viewers or users with …
Built on the trusted SQL Server and Azure SQL Database engine, this is the first fully SaaS-native operational database experience within Microsoft Fabric. It empowers developers, data engineers, and IT professionals to build scalable, secure, and intellige…
Auditing is needed mainly for Security and Compliance reasons, to ensure transparency about everything that happened in the database. Its logs can later be used to:
Currently Point-in-time restore backups default to 7 days. We are now enhancing the ability to customize this retention to anywhere from 1 to 35 days, depending on your business needs for data retention. This setting can be managed in the database settings …
A major upgrade to Copilot for SQL database in Fabric introduces new interactive toolsets in the Sidecar Chat for diagnosing performance, optimizing design & authoring SQL code. Try asking Copilot:
Data virtualization enables you to leverage all the power of Transact-SQL (T-SQL) and seamlessly query external data from OneLake, eliminating the need for data duplication, or ETL processes, allowing for faster analysis and insights.
This milestone is an important advancement in offering Python developers a modern, performant, and user-friendly experience when working with SQL Server, Azure SQL Database, or SQL databases within Microsoft Fabric.
You can now analyze live Cosmos DB data directly in Fabric—no complex or costly ETL required. Data stays in sync with OneLake, providing a single source of truth for real-time and historical insights. As a distributed NoSQL database, Cosmos DB in Fabric bri…
The Spark connector for SQL databases is a high-performance library that makes the read/write of SQL databases in Fabric easier and seamless. This connector offers following capabilities:
Microsoft and Esri have partnered together to bring spatial analytics into Microsoft Fabric for production scenarios. Our collaboration with Esri introduces cutting-edge spatial analytics integrated within Microsoft Fabric Spark notebooks and Spark job defi…
Opening notebooks with large table outputs can be frustrating when performance slows down. Progressive rendering changes to that experience by loading display() outputs incrementally instead of waiting for everything to finish before you can interact. This …
In response to recent feedback from the community, we are pleased to introduce a series of quality improvements to the Fabric Data Engineering VS Code extension.
The User Data Functions has been hard at work to bring you the functionality you need to tie together your Fabric architectures and create robust data solutions. This section will cover the latest features in Fabric User Data Functions for the Microsoft Ign…
Fabric Environment now supports installing Python libraries directly from Azure Artifact Feed! This new capability makes it easier and more secure for teams to manage and deploy custom libraries on scale.
Data agent creators can now connect their agents directly to Azure AI Search indexes built in Microsoft Foundry, unlocking powerful unstructured data scenarios. Using the resource URL, you can securely connect to your index—data agents fully respect the per…
We’ve increased several key limits to give creators more room to guide and shape Data Agent behavior. Data Source Instructions for Eventhouse KQL databases now support up to 15,000 characters (previously 5,000), giving you far more space to describe schemas…
Apply powerful functions such as ai.extract(), ai.classify(), ai.generate\_response(), and more, to turn your data into insights with just a single line of code.
Support for managed MCP server endpoints is now available in Fabric data agents. This enables seamless interoperability across the AI ecosystem, allowing external systems and services to tap into the rich domain expertise of data agents and access curated k…
Data agents in Fabric now deliver enhanced integration with Microsoft 365, enabling seamless access to enterprise data within M365 Copilot. Through this integration, users can query and reason over curated data in OneLake directly from M365 applications, br…
Data Agent in Microsoft Fabric has expanded its capabilities to include direct support for SQL Database Artifacts, eliminating the need for intermediary lakehouses. This enhancement allows users to connect Fabric SQL databases in addition to other mirrored …
Connecting your Lakehouses and Warehouses to the Data Agent is now dramatically simpler. A new entry point in the ribbon of both Lakehouse and Warehouse interfaces allows you to instantly create a Data Agent or add your data source to an existing one.
We’ve made a foundational upgrade to the machine learning tracking system in Microsoft Fabric. This update prepares your workspace for upcoming enhancements, such as advanced tracking capabilities and streamlined cross-workspace model logging, while keeping…
We’ve made an important improvement to machine learning model endpoints. Previously, real-time endpoints couldn’t use internal libraries—a limitation many users faced. Now, you can activate machine learning model endpoints built using AutoML and FLAML, maki…
IDENTITY columns (Preview) in Fabric Data Warehouse, is a long-awaited feature that simplifies surrogate key generation during data ingestion. IDENTITY columns automatically produce unique values for each new row, eliminating the need for manual key assignm…
Data Clustering (Preview) unlocks significant performance gains and reduced consumption use for queries. By organizing rows with similar values together during ingestion, Data Clustering enables aggressive file pruning, only scanning files with data that ma…
Managing data consistency during ETL has always been a challenge for our customers. Dashboards break, KPIs fluctuate, and compliance audits become painful when reporting hits ‘half-loaded’ data.
Fabric Data Warehouse and SQL analytics endpoints for mirrored artifacts now support large string and binary data using VARCHAR(MAX) and VARBINARY(MAX) types.
Two new connectors for Eventstream— HTTP and MongoDB CDC — that make it easier than ever to bring diverse, real-time data into Fabric Real-time Intelligence (RTI) for real-time analytics. You can find both connectors in the Real-Time Hub starting today.
The exchange of real-time data across different data platforms is becoming increasingly popular. We are pleased to announce that the Cribil source is now available in Real-Time Intelligence, allowing real-time data to flow into Fabric RTI Eventstream throug…
In today’s data-driven world, speed matters. Real-time signals are everywhere—customer clicks, IoT telemetry, operational metrics—but they only create value when they lead to action. That’s why we’re excited to share Eventstream Activator destination, now g…
This new capability provides administrators with real-time insights into the health and utilization of their Microsoft Fabric capacities.
As your KQL database grows, tables gather data from several Eventstreams, functions connect different tables, update policies move and transform data, and materialized views quietly keep aggregated data up to date - all working together behind the scenes
Fabric Activator enables you to automatically take actions or send alerts whenever certain data conditions are met.
With operations agent, users can create autonomous agents that monitor data, infer goals, and recommend actions. These agents dynamically construct plans based on business objectives, data sources, and available actions, keeping a human in the loop while en…
Maps now support imagery files such as Cloud Optimized GeoTIFF (COG) and Raster PMTiles, in addition to vector spatial formats, enabling richer geospatial analysis with imagery references. Upload your imagery file to Lakehouse and simply right-click ‘Show o…
Data labeling settings are now available for all geometry types—points, lines, and polygons—reflecting your feedback.
Copilot-assisted real-time data exploration enables users to analyze live data using natural language. This new feature integrates Copilot into Real-Time Dashboards and Real-Time Hub, allowing you to explore the data behind dashboard tiles and tables simply…
Key pair authentication is now available for connecting with the Snowflake connector. When you create a new Snowflake connection or edit an existing one in ‘Manage connections and gateways’, you’ll find the ‘KeyPair’ authentication option.
This new capability simplifies gateway maintenance and helps ensure your environment remains secure and up to date. With this preview, you can now initiate gateway updates manually—either directly from the gateway UI or programmatically through API or scrip…
Virtual Network (VNET) Data Gateway, available in preview, enables secure and flexible enterprise connectivity by allowing certificate-based authentication for compliant gateway communication and proxy configurations for environments where direct internet a…
The new Error Insights Summary Copilot in Pipeline is designed to make error handling smarter and faster. When dealing with pipelines that fail with dozens or even hundreds of errors, it can be overwhelming to investigate each issue manually. With this Copi…
Building Pipeline expressions can be complex -- but it doesn’t have to be. We are introducing a new Copilot capability (currently in preview) that transforms how you create and understand Pipeline expressions in Fabric Data Factory!
Managing your complex orchestration workflows just got easier with Hierarchical view for Pipelines in Monitoring Hub! Jobs are often triggered automatically, and pipelines are one of the most common examples of this. With Hierarchical view, you can now:
This release brings enhanced performance and security to Fabric workloads, particularly when working with large datasets in Dataflow Gen 2.
Modern Get Data experience in Excel Desktop is designed to make finding and connecting to your data sources easier than ever. Instead of navigating multiple menus or guessing where to start, you can now access all available data sources in one central place…
Copilot in Modern Get Data within Dataflow Gen2 allows you to ingest data from both the OneLake catalog and OneDrive for further analysis. These features make it easier to bring in data for your next transformation using natural language. !Fabric_November_2…
These functions bring generative AI capabilities directly into Microsoft Fabric, making it possible to perform advanced AI tasks without needing machine learning expertise. With an intuitive user experience, users can invoke large language models through Fa…
IntelliSense powered by the Power Query Language Service is now integrated with Power Query Online and available inside Dataflow Gen2 as a preview feature.
Job management APIs are now available for Fabric Apache Airflow jobs!
Managing your Apache Airflow workflows is now more convenient with the new UI-based file upload feature. This enhancement allows you to add files directly to your Airflow project through an intuitive interface, streamlining the process of updating configura…
The Apache Airflow Job File Management APIs have been released, representing significant progress toward enhancing the efficiency, security, and developer experience of workflow orchestration. These APIs are designed to give you full control over job files …
We’re enhancing the developer experience by adding keyboard shortcut support to the new multitasking experience with Horizontal Tabbing and Object Explorer. This allows developers to switch tabs and items efficiently using keyboard shortcuts, like professional IDEs. To learn more, refer to the Keyboard shortcuts for Object Explorer and Horizontal…
When developers are editing an item, they often need to maximize the available screen space for the editor pane. Focus Mode allows you to hide navigation sidebar and the object explorer, giving you a distraction-free surface to concentrate on editing. Select Focus Mode from the global header. The navigation sidebar and the object explorer (if you…
With Outbound Access Protection for Spark, organizations can govern outbound connections from their Spark workloads in Fabric workspaces to external destinations and other Fabric workspaces within the same tenant providing organizations with granular controls to protect against data exfiltration. We are actively working to expand OAP support for…
Private link for Fabric workspaces empowers organizations to secure their Fabric workspaces with fine-grained network isolation, allowing private, secure access from their virtual networks — without traversing the public internet. Fabric_October_2025_Feature_Summary AI-generated content may be incorrect." /> Refer to the Workspace outbound access…
Data teams have long struggled with the File Size Dilemma: the ideal file size for a 10GB table can be disastrous when used for a 10TB table. The new Adaptive Target File Size feature uses Delta table telemetry to estimate the ideal target file size based on heuristics like the table's current size, and then automatically updates that target as…
Fabric Spark connector for SQL databases (Azure SQL databases, Azure SQL Managed Instances, Fabric SQL databases and SQL Server in Azure VM) in the Fabric Spark runtime is now available. This connector enables Spark developers and data scientists to access and work with data from SQL database engines using a simplified Spark API. The connector…
As Spark applications continue to grow in scale and duration, efficient log management and analysis have become increasingly critical. To address these evolving needs, we’ve introduced enhancements to the Spark History Server (for completed applications) and Spark UI (for running applications), enabling executor rolling logs for Spark 3.4 and…
When opening a lakehouse in Lakehouse Explorer, users see a preview of the first table by default. Now, users can generate a unique URL for any table in the lakehouse, allowing them to preview that specific table directly. By copying and sharing this URL with others who have access, recipients can open Lakehouse Explorer with the chosen table…
We’ve created a new integration for Data Agent directly within Lakehouse experiences. This enhancement is designed to streamline and accelerate your journey from raw data to actionable intelligence just with a few clicks. How it works: Start in your Lakehouse. Select the ‘Add to data agent’ button in the ribbon. Select create a new Data Agent…
The new UI introduces two dedicated tabs—Data and Setup—making it easier than ever to design, test, and refine your agent. Under the Setup tab, you can see and apply all the relevant settings for your data sources, while seamlessly switching back to the Data tab to chat with your agent and test how your configurations affect its behavior—without…
Data Warehouse enables you to efficiently read and ingest JSONL (JSON Lines) files by leveraging the OPENROWSET function. With the OPENROWSET function, you can reference one or many JSONL files and read their content as a set of rows. SELECT * FROM OPENROWSET(BULK '/Files/jsonl/year=*/month=*/tweets-*.jsonl' ) Each property found in the JSON…
The data_source option in the OPENROWSET function allows you to simplify data access to files in the lake by using a relative file path and referencing a data source that points to a root folder location. You can create an external data source with a location that refers to the location of the lakehouse folder: CREATE EXTERNAL DATA SOURCE…
As part of our ongoing investments to enhance concurrency and reliability in Fabric Data Warehouse, we’re introducing Compaction Preemption, a smart new capability that intelligently prevents write-write conflicts caused by background compaction tasks. These tasks optimize storage by rewriting small, inefficient parquet files into fewer, larger…
Fabric Graph is Microsoft’s first horizontally scalable, native graph data management, analytics, and visualization service. Inspired by LinkedIn's graph engine that efficiently maps over a billion interconnected entities, Fabric Graph helps organizations uncover and act on insights hidden in their most complex, interwoven data. It is a foundation…
Fabric Eventstream now supports MongoDB Change Data Capture (CDC) as a fully managed connector, expanding its rich set of streaming data sources. With this connector, you can stream CDC events from MongoDB to Eventstream for real-time processing and analytics. Highlights of MongoDB CDC Connector Compatible with all MongoDB deployments, including…
Fabric Eventstream now supports sourcing events from an EventHub source while enforcing schema on the payloads. This integration enables data engineers and developers to build governed, type-safe event streaming pipelines using header-based schema validation. This integration leverages Fabric's Schema Registry to validate events at ingestion,…
Eventstream customers can now pause/resume their traffic for their derived stream . This capability gives customers greater operational control and flexibility over their event-driven workflows. Cost Optimization: Pause traffic during maintenance windows or low-demand periods without deleting or recreating streams. Operational Continuity: Resume…
Copy job supports even more file formats—including ORC, Excel, Avro, and XML—so you can move data from any source to any destination with greater flexibility. Whether you're working with structured tables or semi-structured files, Copy job lets you seamlessly ingest, and distribute your data in the format that best fits your business and analytics…
It is now possible to set the Quote character, Escape character, and encoding options when transferring data in CSV format through a Copy job. Fabric_October_2025_Feature_Summary AI-generated content may be incorrect." /> With these options, you can: Precisely control how text values and delimiters are handled, ensuring accurate data parsing.…
In September we unveiled the new integration between Variables libraries and Dataflow Gen2 . Improvements have since been made to this experience. Gateway support : evaluations running through a Gateway can now leverage variable libraries during run time. The minimum required gateway version is 3000.282 . Power Query editor support : when creating…
Export Query Results in Power BI Desktop unlocks seamless data portability and collaboration across Microsoft Fabric. This feature empowers analysts to take transformed, cleaned data from Power Query and export it directly to trusted destinations - such as Dataflows Gen2, Lakehouses, and other cloud stores - without relying on complex workarounds…
In today’s data-driven world, effective data governance is crucial for ensuring the integrity, security, and usability of data. We’re excited to announce the general availability of the governance experience within the OneLake catalog. With this experience we’re empowering individual data owners with the tools and insights they need to govern and…
Microsoft Fabric data mesh architecture / federated architectures support organizing data into domains and sub domains, helping admins to manage and govern the data per business context with various delegated settings and the ability to create dedicated tags. Domains and sub domain structures enable data consumers to filter and discover content…
Microsoft Purview protection policies provide a powerful and automated way to enforce data governance and security within Microsoft Fabric. These policies leverage sensitivity labels from Microsoft Purview Information Protection to automatically restrict access to sensitive data assets, like Lakehouses or KQL databases, within Fabric. Instead of…
Once defined, these labels apply automatically to all new items created in the specified domain, allowing you to use a centralized configuration to reduce human error and ensure consistent data handling across the organization. Fabric_September_2025_Feature_Summary AI-generated content may be incorrect." class="wp-image-28110"/> Refer to the…
In Microsoft Fabric, Data Loss Prevention (DLP) policies are a game-changer for organizations by acting as a proactive defense for sensitive data. These policies automatically identify and protect confidential information—such as personally identifiable information (PII), financial data, or intellectual property—as it's created or moved within the…
Beginning September 30th, the Variable library item will officially be Generally Available and will be supported as such in Pipelines. Additionally, support for Variable library is expanding beyond Shortcut for Lakehouse. Variable library can now also be used in: Dataflow Gen 2 - Fabric Variable libraries in Dataflow Gen2 with CI/CD (Preview) Copy…
Fabric_September_2025_Feature_Summary AI-generated content may be incorrect."> The new design for Deployment pipelines will be generally available beginning September 30th, 2025. As part of this rollout, the previous design will be deprecated and is scheduled for removal in the upcoming quarter. A formal notice will be issued 30 days in advance to…
Introducing additional resources and data sources in the Terraform Provider for Microsoft Fabric, enabling broader Infrastructure as Code coverage. With these additions, teams can automate even more aspects of their Fabric environment using Infrastructure as Code (IaC). Newly Added Resources and Data sources Connections OneLake Shortcut…
Fabric CLI provides developers with a fast, scriptable, and intuitive way to navigate and operate Microsoft Fabric — whether locally or in CI/CD pipelines. Since its debut earlier this year, it’s already reshaping how teams automate workflows and manage their data estate. Now, we’re taking the next step by opening it up to the community. This…
We’ve shipped v1.1.0 with a focus on usability, reliability, connectivity, and groundwork for AI-assisted contributions based on your top asks. Output formatting, JSON - machine-readable output for automation and pipelines. Folder support, organize items in folders/subfolders with predictable, path-like ops. Command & argument autocomplete faster,…
Fabric MCP, is a developer-focused Model Context Protocol server that enables AI-assisted code generation and item authoring in Microsoft Fabric. It streamlines how developers build around Fabric’s public APIs and create Fabric items using built-in templates and best-practice instructions — reducing coding time, minimizing errors, and boosting…
The Microsoft Fabric Extensibility Toolkit is the next evolution of the Workload Development Kit. The new toolkit represents a significant step forward in enabling organizations to create and integrate data applications that show up in Microsoft Fabric . Now organizations and software development companies can build Fabric items within days or…
This capability allows workspace admins to add additional workloads directly to their workspaces, eliminating the need for tenant or capacity-level setup. Key highlights include: Assign workloads from the Workloads Hub directly to a workspace. Enable multiple workloads in a single workspace without impacting the rest of the tenant. Maintain…
We’ve rolled out a set of UI enhancements in Fabric aimed at making multitasking smoother and more intuitive. Inspired by modern IDEs, these updates include: Horizontal tab s for open items with clear labels. Fabric_September_2025_Feature_Summary Support for multiple active workspaces with color coding and numeric labels.…
This feature provides a Fabric-native platform to host and run your business logic using Python functions. With Fabric User Data Functions, you can do the following: Easily create and publish functions to run on Fabric using the in-browser portal editor or with the native VS Code extension using templates and libraries. Connect to your Fabric data…
With Fabric User Data Functions now generally available, the following are the new features we’re introducing: Test your functions using Develop mode : This feature allows you to execute your functions in real-time before publishing them. OpenAPI spec generation in Functions portal: You can access the OpenAPI specification for your functions using…
Building on UDF in preview, we've made considerable advancements to native support for pandas DataFrames and Series, powered by Apache Arrow. With the built-in UDF capabilities in NotebookUtils, you can: Browse all functions within a UDF item. Invoke specific functions directly from your notebook. Explore metadata such as parameters, signatures,…
Materialized Lake Views (MLV) in Microsoft Fabric have received several powerful enhancements designed to improve refresh performance, lineage visibility, environment customization, and operational flexibility. These updates help organizations optimize data workflows, ensure transparency, and tailor resource usage to specific workload needs.…
Python Notebook is a pure Python experience built on top of Fabric notebook, designed for data analysis, visualization, and machine learning, providing a smooth Python coding and execution environment. Key features Multiple built-in Python kernels: Built-in Python 3.10 and 3.11 with native features like iPyWidget and magic commands. Users can…
These APIs have been designed to streamline and enhance your workflow by providing powerful programmatic capabilities for managing notebooks and lakehouse assets, as well as improving performance and usability. RunMultiple: You can use notebookutils.notebook.runMultiple() to run multiple notebooks in parallel or in a predefined topological order.…
This integration enhances Python development by providing intelligent code completions, precise error detection, and comprehensive code insights. It is supported for both PySpark environment and Python environment of notebook, and by default enabled for all notebook users. Key highlights include: Smarter and more relevant autocompletion Enhanced…
With the resource monitor pane, you can now track critical runtime information such as session duration, compute type, and real-time resource metrics—including CPU and memory consumption—directly within your notebook. This feature offers a clear and immediate overview of your active session, helping you stay informed about the resources your code…
This brings a new set of capabilities, improved contracts, and a migration and deprecation plan for existing APIs. What’s new? Create, get or update environment with definition. Import, export or remove external libraries (staging & published state). Upload or delete custom library. How to migrate? Existing APIs with contract update Some APIs have…
You can now connect and query mirrored databases (MirrorDBs) directly from your Spark notebooks, making it easier than ever to analyze data across your enterprise. This update allows you to: Add MirrorDBs as data sources in your notebook and run read-only Spark queries on mirrored database tables using SparkSQL or PySpark—just like you do with…
Download files directly from any Lakehouse item, empowering you to work more efficiently, reduce friction in your data workflows, and gain faster insights. Capabilities Download files from both table files and the File section (with required permission). Keep your data secure and compliant by including Microsoft Information Protection (MIP)…
It's now easier than ever to organize and access your data. You can now add, view and manage multiple lakehouses in a single unified view. Capabilities Quickly add multiple reference lakehouses that you have permission to ensuring secure collaboration. Work with several lakehouses in a consolidated view, with clear distinction between your primary…
Introducing advanced observability features and improved automation for managing Spark workloads in Microsoft Fabric! New APIs for Single Spark Applications. Spark Advisor API - Provides recommendations and skew diagnostics to help identify bottlenecks and optimize performance. Resource Usage API - Offers granular metrics on vCore allocation and…
We’ve introduced a series of enhancements based on customer feedback and product readiness. These include improved accessibility through UI refinements that meet compliance standards, support for analyzing Spark applications while they’re still running, and a major upgrade to the anomaly detection infrastructure for more accurate and scalable…
This new capability enables developers and data engineers to analyze, debug, and optimize Spark performance across multiple application runs—whether you're evaluating the impact of code changes or data variations. The Spark Applications Comparison feature lets users select and compare up to four Spark application runs side by side. By visualizing…
Microsoft enables users to directly connect mirrored database artifacts including Azure Cosmos DBs, Azure SQL, Oracle, Snowflake, Databricks, and other databases using open mirroring. Including This integration allows users to leverage Data Agent’s Natural Language to SQL (NL2SQL) capability, so users can ask questions in plain English, and…
Fabric Data Agents now support CI/CD, ALM flow, and Git integration, enhancing management, version control, and collaboration for Data Agent artifacts. These features promote reliable, scalable, and auditable development practices by enabling systematic management of changes, dedicated workspaces for development stages, and broad data source…
This new feature empowers developers to integrate Fabric Data Agents into custom web apps and workflows, enabling natural language querying, automated reporting, and embedded insights—all while respecting user identity and permissions via Microsoft Entra ID. Setup in Visual Studio Code, including cloning the sample client, configure authentication…
The Fabric Data Agent SDK now offers evaluate_few_shot_examples(), a tool for creators to get structured feedback on their example queries. For each example, the function assesses clarity (determining if the natural language question is clear and unambiguous), mapping (checking if the SQL query accurately reflects the intent of the question), and…
When the Data Agent answers a question, it reviews the example queries you’ve provided and uses them to guide its reasoning. With our latest update, creators can view exactly which example queries were used during a run-step to help shape the agent’s response. Fabric_September_2025_Feature_Summary AI-generated content may be incorrect."…
Download a diagnostics file for any run step in the Data Agent chat canvas—giving you clear visibility into how the agent processed your question behind the scenes. The file includes details like which tools were used, how the question was interpreted, the intermediate reasoning steps, and any errors or fallback logic that occurred. A powerful way…
The ability to apply AI functions directly within Data Wrangler to transform your data quickly and visually is now available. AI functions allow you to perform tasks like text summarization, classification, translation, sentiment analysis, grammar correction, or your own prompt, all without writing complex code. See your transformations instantly…
Accelerate data prep with AI-powered capabilities in Data Wrangler . In the visual interface, you can see smart suggestions from Microsoft PROSE for operations that are relevant to your data frame. Describe your desired transformations in natural language, and Copilot will generate code and an instant preview of the results.…
This command blends INSERT, UPDATE, and DELETE operations all into a single statement based on your specified conditions between two tables, improving readability and providing a uniform standard for transformations across your ETL jobs. Fabric_September_2025_Feature_Summary AI-generated content may be incorrect." class="wp-image-28139"/> For more…
This AI powered assistance helps you migrate your analytical warehouse or database from Azure Synapse Analytics dedicated SQL pool or SQL server database used for analytics work to Fabric Data Warehouse using a DACPAC file. Fabric_September_2025_Feature_Summary For more details, refer to the Migration Assistant for Fabric Data Warehouse…
Geospatial insights into the Real-Time Intelligence workload are available with Maps in Microsoft Fabric. Users can ingest location data from a Lakehouse or Eventhouse, visualize it instantly, and build map-centric applications without specialized knowledge or writing code. Whether you are tracking mobile assets, analyzing campaign performance, or…
Azure Monitor Diagnostic Logs now integrate directly with Microsoft Fabric via Eventstream, enabling real-time ingestion of metrics and logs from Azure resources into Fabric-native analytics workflows for immediate transformation and analysis—eliminating the need for manual data pipelines. Once ingested into Eventstream, data can be cleaned,…
Introducing the integration of Workspace Private Link with Eventstream, enabling secure, private connectivity between your data sources and Microsoft Fabric—without exposure to the public internet. A workspace-level private link maps a workspace to a specific virtual network using the Azure Private Link service. With this integration in…
We’re excited to announce a major performance upgrade to Activator, our no-code, low-latency event detection engine that helps power Real-Time Intelligence in Microsoft Fabric. Activator now supports up to 10,000 events per second (EPS), a tenfold increase from the previous 1,000 EPS limit. This change unlocks new possibilities for customers…
In today’s fast-paced digital landscape, spotting anomalies in your data as they happen can make all the difference. Whether you’re a seasoned data professional or a business user keeping an eye on operations, the new anomaly detection feature in Real-Time Intelligence puts powerful insights right at your fingertips—no coding required. To get…
The OneLake catalog now features a dedicated Secure tab, offering a centralized view of security settings across your Fabric items. The Secure tab provides two powerful lenses into your security setup: users and security roles. The View Users page combines user permissions across workspaces, letting you identify users with privileges they…
This new capability allows customers to continuously replicate BigQuery data into OneLake —Fabric’s Unified Data Lake—with zero ETL. With near real-time replication and native integration across the Fabric experience, Mirroring makes it seamless to bring BigQuery data into Fabric. This unlocks the full power of Microsoft’s integrated suite for…
This new capability empowers customers to continuously replicate data from their Oracle databases—including on-premises, Oracle OCI, and Exadata—directly into OneLake, Fabric’s unified data lake, with near real-time performance and zero ETL. Mirroring for Oracle is natively integrated across the Fabric experience, making it seamless to bring…
This milestone marks a significant step forward in our mission to provide seamless, near-real-time data replication capabilities, empowering you to derive maximum value from your SQL data with Microsoft’s unified data platform. Mirroring for Azure SQL Managed Instance offers continuous data replication into OneLake, ensuring that your data remains…
With this release, organizations can now securely and efficiently replicate data from key sources – with general availability for Snowflake, Azure SQL Database, and Azure SQL Managed Instance – using either the On-Premises Data Gateway (OPDG) or the VNET Data Gateway. This ensures seamless data movement into OneLake, while maintaining robust…
You can now use Fabric Workspace Identity authentication to mirror your Azure SQL Database, in addition to the basic (username and password), organization account and service principal authentication options. Workspace Identity authentication in connections leverages Microsoft Entra ID to provide seamless, secure access to data sources using your…
We’ve heard your feedback and have made several new features, and improvements to Fabric VS Code Extension . The extension offers enhanced capabilities for managing Fabric items, multi-workspace support, and direct integration with Fabric SQL databases—all within Visual Studio Code. Key features Programmatic Management: Manage Fabric items…
Lucid Data Hub has launched Agent Mart Studio as a workload in Microsoft Fabric, empowering business users to build and deploy AI agents directly on enterprise data in OneLake. This integration allows organizations to automate complex business processes with AI agents that leverage unique industry knowledge and are protected by contextual…
Statsig Experimentation Analytics on Microsoft Fabric offers an integrated solution that empowers product teams to innovate and accelerate data-driven decision making by unifying experimentation, feature rollout, and impact analysis within the Microsoft Fabric ecosystem. It provides a frictionless, secure way to store and analyze experimentation…
Introducing several enhancements to Copilot in SQL in Fabric and Query Editor: Connect in SSMS with One Click: Instantly connect to your Fabric SQL database in SQL Server Management Studio (SSMS) without manual entry—streamlining developer workflows and reducing friction for data professionals. Bulk Query Management: Delete multiple queries at…
The latest version of the MSSQL extension for VS Code introduces Fabric connectivity and provisioning (Public Preview), bringing SQL database in Fabric directly into your editor. Instead of switching to the Fabric Portal, copying connection strings, or creating databases outside VS Code, you can now authenticate with Microsoft Entra ID, browse…
PITR allows users to restore a database to any specific moment within the configured retention window. Whether recovering from a user error, application bug, or security incident, PITR provides granular control to rewind your database to a known good state. Until recently, PITR in Fabric SQL DB supported a 7-day retention window . With the latest…
Fabric SQL’s Git integration is now rolling out, including the following features: Validation of system object references (e.g., tables/views in the [sys] schema) during local development. Tracking of shared queries, allowing teams to monitor changes over time and maintain version control across collaborative environments.…
Fabric SQL empowers developers with REST APIs to: Export database object definitions as portable DACPAC files. Import compiled definitions (DACPAC) to update existing databases, with automatic diff detection and application of changes. To learn more about this feature, refer to the Create a SQL database with the REST API documentation.
The performance dashboard now provides memory consumption metrics. This new feature offers real-time insights into memory usage by individual database queries, enabling better resource management and optimization. The dashboard now includes memory consumption alongside CPU usage, user connections, requests per second, blocked queries, database…
Copy job now supports Fabric Lakehouse Table connector with native CDC support. This connector enables efficient, automated replication of changed data—including inserts, updates, and deletes—from a Fabric Lakehouse via Delta Change Data Feed (CDF) to supported destinations. With this enhancement, your destination data stays continuously up to…
Copy job now supports connection parameterization via variable library! This powerful capability helps automate your CI/CD processes by externalizing connection values. With it, you can deploy the same Copy job across multiple environments while relying on the variable library to inject the correct connection for each stage. Meaning you can…
You can now choose to merge changed data—including inserts, updates, and deletions—into Snowflake, when the data originates from any CDC source connectors such as Azure SQL DB, SQL Server, SQL MI, or Fabric Lakehouse tables. Fabric_September_2025_Feature_Summary AI-generated content may be incorrect." class="wp-image-28192"/> What’s more, with…
More source and destination connections are now available, giving you greater flexibility for data ingestion with Copy job. We’re not stopping here—even more connectors are coming soon! Fabric_September_2025_Feature_Summary AI-generated content may be incorrect." class="wp-image-28193"/> Newly supported connectors Folder REST SAP Table SAP BW Open…
Access the full power of the Copy job by selecting ‘Copy Assistant’ from a pipeline. This streamlined experience makes it easier to configure and manage data movement within your workflows. Eliminating the need for unnecessary parameterized foreach loops and copy activities as before for simple data copying. It also empowers you to benefit from…
Why the Change? We’re making Fabric Data Factory pipelines more inclusive and adaptable by simplifying language and broadening our mission. ‘Data pipelines’ are now simply ‘pipelines’, reflecting our commitment to extending Fabric Data Factory’s capabilities to fit more diverse and extended use cases. This update isn’t just semantic—it signals a…
These updates introduce a modern UX and enhanced functionality—making it easier than ever to integrate communication seamlessly into your pipelines. What’s New? The new activities are designed to be more intuitive, flexible, and future-ready. Whether you're sending notifications, triggering actions, or collaborating across Teams, these activities…
Introducing a major usability upgrade to the Dataflow activity in Microsoft Fabric! When using a Dataflow Gen2 with public parameters mode enabled , you’ll now benefit from a streamlined experience that makes working with parameters faster and more intuitive. Fabric_September_2025_Feature_Summary Description automatically generated"…
The Expression Builder Evaluate experience is now available in Microsoft Fabric pipelines! This new capability is designed to make working with dynamic pipeline content easier, faster, and more intuitive. What is it? We’ve heard from many of you that writing and debugging expressions can be frustrating. The evaluate expression experience helps…
This milestone unlocks powerful new capabilities for building reusable, secure, and parameterized logic within your pipelines. Easily invoke custom functions across multiple pipelines to streamline complex workflows. You’ll also be able to pass secure inputs and outputs, configure retry logic, and manage parameters with full control. With the…
You now have the capability to add multiple schedules to your pipelines in Fabric Data Factory! With this new update, you can add up to 20 schedules to your pipeline, giving you greater flexibility to automate runs at different times. This enhancement allows teams to better align their data processing with organizational needs, ensuring timely…
Expanded secure connectivity options are now available in Microsoft Fabric Data Factory! With support for On-premises Data Gateway (OPDG) and Virtual Network (VNet) Data Gateway, you can orchestrate two of the most popular activities—Invoke pipeline and Semantic Model Refresh—while keeping your data secure inside your corporate network. Why This…
This new orchestration activity simplifies data movement by bringing the familiar Copy job item directly into Microsoft Fabric Data Factory pipelines. You can now manage data transfers alongside transformations, notifications, and more—all within a single, unified experience. Fabric_September_2025_Feature_Summary AI-generated content may be…
This release marks a major milestone, empowering users to seamlessly trigger and orchestrate pipelines within their Fabric Data Factory workflows, making it easier than ever to build robust and flexible data solutions. Fabric_September_2025_Feature_Summary AI-generated content may be incorrect." class="wp-image-28186"/> For more information, refer…
Introducing support for Workspace Identity across key Microsoft Fabric Data Factory activities! With this update, you can now leverage workspace identity to securely and seamlessly execute Invoke Pipeline, Semantic Model, and Scope Activity operations. This enhancement simplifies authentication, strengthens security, and streamlines management by…
With this release, users can now seamlessly manage and reuse variables across multiple pipeline activities, simplifying workflow design and enhancing flexibility. The integrated Variable Library empowers teams to standardize variable usage, reduce errors, and streamline pipeline configuration, making it easier than ever to build scalable,…
Databrick Jobs allow you to schedule and orchestrate a task or multiple tasks in a workflow in your Databricks workspace. Since any operation in Databricks can be a task, this means you can now run anything in Databricks via Fabric Data Factory, such as serverless jobs, SQL tasks, Delta Live Tables, and more. You can find the Job type in your…
Dataflow Gen2 empowers users with a visual, intuitive experience for shaping and transforming data directly within Microsoft Fabric. At the heart of this experience is the data preview pane, which evaluates each transformation step independently to ensure accurate previews tailored to your scenario. However, rendering the full schema and data…
The Modern Query Evaluation Engine for Dataflow Gen2 (CI/CD) is a powerful enhancement that can substantially improve the performance of query evaluation in your dataflows. This new engine is designed to deliver faster and more efficient execution, helping you scale your data transformation workflows with greater speed and reliability. The Modern…
Microsoft Fabric now offers Partitioned Compute in Dataflow Gen2, enabling parallel execution of dataflow logic to significantly reduce evaluation time. This feature is perfect for handling large file sets, like those in Azure Data Lake Storage Gen2, where operations can be done simultaneously. Fabric_September_2025_Feature_Summary Description…
Microsoft Fabric now supports Variable libraries in Dataflow Gen2 with CI/CD. This new capability introduces dynamic configuration management across environments, helping teams streamline CI/CD workflows and improve reusability. With this integration, dataflows can reference centralized variables using the Variable.Value and…
This powerful feature enables dynamic and flexible dataflow refresh by allowing parameter values to be passed externally—via the Fabric REST API or native Fabric experiences—without modifying the dataflow itself. Updates and Improvements Over the past few months in preview, we’ve introduced several enhancements based on user feedback: New…
The new Discover Dataflow Gen2 Parameters API in Microsoft Fabric empowers developers and data professionals to programmatically retrieve all parameters defined within a Dataflow Gen2 with CI/CD that has the public parameters mode enabled. This capability is a key part of the broader public parameters initiative, which aims to make Dataflows more…
With this update, you can now leverage incremental refresh to efficiently manage and update large datasets within your Lakehouse environments. This unlocks faster processing times and optimized resource utilization. This new capability empowers organizations to keep their Lakehouse data fresh while minimizing overhead and maintaining robust…
New data destinations for Dataflow Gen2 are being introduced. Users can now write data directly to Lakehouse files (CSV) further expanding integration options for diverse analytics needs. Additionally, we're offering an early sneak peek at Snowflake as a destination, while it's entering preview. This glimpse gives you an opportunity to explore…
This powerful new capability makes it even easier to organize and manage your data within complex analytics environments. To take advantage of schema support, simply enable ‘Navigate using full hierarchy’ under Advanced settings when configuring the connection for your chosen data destination. With this enhancement, you can seamlessly map your…
Earlier this year we released a new copilot-driven experience that aims to help you in creating custom columns with just natural language. This experience is available within the 'Custom column' dialog which you can find through the 'Add column' tab of the ribbon. With it you can describe with a simple prompt what you wish your new column to…
This new capability brings the power of AI directly into your data transformation workflows by helping you interpret Mashup (Power Query M) code in natural language. Whether you're reviewing a full query or a specific step, Copilot makes it easier than ever to understand and debug your dataflows. Key Features Explain this query: Triggered via the…
With this new Copilot in MGD experience in Fabric Dataflow Gen2, you can ingest and transform data effortlessly with natural language commands. Discover a faster, smarter way to get the data you need. In Fabric Dataflow Gen2, select Get data to begin. In the Get data wizard, select the Copilot tab, then you can start with the list of recently used…
You can utilize Microsoft Entra ID authentication to connect to PostgreSQL databases in Dataflow Gen2, as an alternative to traditional username and password authentication. Fabric_September_2025_Feature_Summary AI-generated content may be incorrect." class="wp-image-28167"/> For more information, refer to the PostgreSQL connector documentation.
A new 2-tier pricing model for Dataflow Gen2 has been introduced, with the aim of making query evaluation more affordable and transparent for users. This update is part of our ongoing commitment to respond directly to customer feedback and deliver more cost-effective solutions for diverse workloads. First 10 Minutes: Query evaluation is now billed…
The addition of a wide range of new connectors in Fabric Data Factory expands the options available for various data integration scenarios. These new connectors that are now supported across Copy job, Copy activity, and Lookup activity in Pipeline, giving you even greater flexibility to connect with diverse data sources. Generally Available Amazon…
We are dedicated to enabling organizations to realize the complete potential of their data by providing integration solutions that are seamless, dependable, and scalable. To keep pace, we continuously ship connector innovations to simplify the developer’s experience and improve productivity. Now, both Salesforce and Salesforce Service Cloud…
Fabric Lakehouse connector is one of the core connectors that empowers enterprise to bring data into Fabric OneLake. We’re continuously delivering innovations to simplify data ingestion. The latest enhancement adds upsert support to the Lakehouse connector, allowing you to write directly to Delta tables. With upsert, you can efficiently manage…
The Lakehouse connector now supports delta column mapping and deletion vectors, further strengthening its ability to work seamlessly with delta tables in Fabric OneLake. With column mapping, you gain flexibility to handle schema evolution and align columns across different systems without manual adjustments. Deletion vector support ensures that…
The Fabric Data Warehouse connector now supports the varchar(max) data type during table creation, giving you greater flexibility to handle large text data without truncation. Users can specify this data type in column mapping when creating tables, whether using Copy job or Copy activity in Pipeline. Making it easier to ingest and store extensive…
The DB2 connector now allows users to specify a package collection directly within the pipeline, providing greater control and ensuring better alignment with DB2 database configurations. This capability is available as an advanced setting in copy activity, enabling more precise and efficient data integration.…
The Snowflake connector now supports specifying a role directly within your pipeline. This enables users to run the copy with right level of access, helping stay aligned with the organization’s security and governance practices without extra configuration steps. This is now an advanced setting available in copy activity.…
You can now use Pipeline and Copy job with the Virtual Network (VNET) Data Gateway in Microsoft Fabric. Enabling a secure, high-performance way to move data between private networks and Fabric without exposing it to the public internet. This integration is especially valuable for industries with strict compliance requirements—such as finance,…
Fabric Data Factory orchestration capabilities focus on more than just scaled-out low-code pipelines, which we’ve offered for many years in ADF & Fabric Data Factory. We also encourage code-first Python-based DAG orchestration by using Apache Airflow Job in Fabric Data Factory. Fabric Notebooks now seamlessly integrate with your Airflow DAGs,…
This new capability empowers data engineers and developers to seamlessly automate deployment and management of Airflow workflows, integrating best DevOps practices directly within the Fabric environment. In Fabric, you have two tools to support CI/CD: Git integration and deployment pipelines. Git integration lets you connect to your own…
We’ve rolled out a new ‘Flat list’ view for stage content in the Deployment pipelines! This update enables selecting items across workspace folders and offers greater clarity when using the ‘Select related’ button during deployment. To switch between views, use the new toggle located in the top-right corner of the stage content area:…
I’m excited to share that we’ve successfully published the Microsoft Fabric APIs Specification in the microsoft/fabric-rest-api-specs GitHub repository! This new repository serves as the official source for REST API specifications for Microsoft Fabric. It's designed to provide developers with a comprehensive, well-organized, and easily accessible…
Support for service principals and cross-tenant integration with Azure DevOps is scheduled to launch in mid-September 2025. This highly anticipated feature enables a comprehensive set of automation processes for Fabric customers. For example, Users can now automate workspace setup using tools like the Fabric CLI and Terraform provider and connect…
Microsoft Fabric has introduced Autoscale Billing for Apache Spark. This is a serverless, pay-as-you-go billing model designed to offer flexibility, transparency, and cost efficiency for Spark workloads. With Autoscale Billing, Spark jobs run independently of your Fabric capacity and are billed only for execution time. Providing teams the freedom…
Microsoft Fabric Data Engineering now gives capacity admins more control over job bursting . By default, Fabric allows Spark jobs to burst up to 3 x’s their base CU allocation , improving throughput for heavy workloads. August_2025_Fabric_Feature_Summary AI-generated content may be incorrect." /> With the new ‘Disable Job-level Bursting’ switch…
JobInsight is a Java-based diagnostic library that enables developers and data engineers to analyze completed Spark applications directly within Microsoft Fabric Notebooks. JobInsight provides two core capabilities: Interactive Spark Job Analysis Offers structured APIs that return execution data - such as Spark queries, jobs, stages, tasks, and…
Enhancements to the Spark application detail view now improve monitoring for Notebooks running in high concurrency mode, whether manually or via pipeline. These changes offer better visibility in Spark applications, support efficient debugging, and aid performance tuning across multiple Notebooks. August_2025_Fabric_Feature_Summary AI-generated…
A major upgrade to Notebook integration with Fabric User Data Functions (UDFs) is now available: Pandas DataFrames and Series can now be used as input and output types—thanks to native integration with Apache Arrow! This update brings higher performance, improved efficiency, and greater scalability to your Fabric Notebooks—enabling seamless…
Notebook Snapshots now support running Notebooks, regardless of the method used to trigger them. Whether executed through pipeline activities in a high-concurrency shared session or a standard session, via a direct Notebook schedule, or initiated using NotebookUtils.run() or NotebookUtils.runMultiple(), you can now view the Notebook Snapshot in…
The Functions portal includes a Generate invocation code feature that allows for automatic generation of an Open API specification for Fabric User Data Functions. August_2025_Fabric_Feature_Summary AI-generated content may be incorrect." /> The Open API specification , formerly Swagger Specification, is a widely used, language-agnostic description…
A new Test capability is available for Fabric User Data Functions. This feature enables users to test and validate functions in real-time prior to publishing. With the Test capability, you can execute your functions in a dedicated Python runtime and get immediate feedback for all your code changes including libraries and connections.…
Fabric now supports real-time inferencing with ML models via secure, scalable, and easy-to-use online endpoints. These endpoints are available as built-in properties of most Fabric models—and they require minimal setup to kick off fully managed deployments. Users can activate and customize model endpoints with a public-facing REST API or directly…
Data Agent is officially lifting restrictions on adding Data Sources with larger schema sizes. Users can now add Kusto, Semantic Model, Lakehouse, and Warehouse Data sources that contain over 100 Columns + Measures and more than 1000 Tables to the Data Agent. This change allows users to bring larger-scale databases and semantic models into…
In July of 2025, we introduced the SQL analytics endpoint Metadata Sync REST API in GA. With this API you can programmatically trigger a refresh of your SQL analytics endpoint to keep tables in sync with any changes made in your lakehouse, native and mirrored databases, ensuring that you can keep your data up to date as needed. To use this…
The Preview of COPY INTO and OPENROWSET from OneLake in Microsoft Fabric Data Warehouse has been announced, providing secure, workspace-governed data ingestion and file querying without dependence on external storage services. This new capability allows users to ingest and query files stored in Lakehouse Files folders using familiar SQL syntax —…
In April 2025, we introduced the Preview of SQL Audit Logs in Microsoft Fabric Data Warehouse—empowering organizations to capture critical audit events for improved transparency, governance, and control. A major enhancement is now available: a new visual interface for configuring and managing audit logs is accessible within the Fabric Warehouse…
Microsoft Fabric will consolidate audit log operation names beginning after July 7, 2025, to facilitate governance processes. Actions like Create Datamart or Delete Warehouse will now appear as standardized entries—such as CreateArtifact, DeleteArtifact, UpdateArtifact, etc. This change aligns with Fabric’s unified platform model and reduces noise…
SHOWPLAN_XML is now Generally Available for the Fabric Data Warehouse and Lakehouse SQL analytics endpoint! The SHOWPLAN_XML set statement and its ‘Display estimated execution plan’ counterpart in SQL Server Management Studio are staple tools for investigating the details of a T-SQL queryplan: providing information on planned data movements,…
With Activator, users are now able to view additional analytics and KPIs related to their activations. By navigating to the History pivot in the rules section of Activator, these analytics can be accessed. Inserting_image Select ‘View details’ in your Teams messages and emails will take you to the History tab of your alert in Activator, where…
Exploring your data sources in Queryset just got easier. The data tree now comes with a refreshed UI that gives you more control over how your connections are displayed - helping you focus faster and write with context. You can now toggle between two views: Flat list of all connected databases. Grouped view by cluster or data source.…
Writing queries in Real-Time Dashboards just got significantly easier. The Edit Tile experience now includes a data source tree - bringing full visibility into your connected data right where you work. With this new pane, you no longer must rely solely on memory or IntelliSense. As you build your query, you can browse your data source in real time…
A new, streamlined user interface has been introduced for sharing queries in Queryset. This update enhances clarity and usability by providing a preview of the content being copied to the clipboard. Users can conveniently select between copying the raw query, a deep link, results, or any combination thereof. August_2025_Fabric_Feature_Summary…
Accelerated OneLake Table shortcuts caches and indexes data as it lands in OneLake, providing performance comparable to ingesting data in Eventhouse. By using this feature, you can accelerate data landing in OneLake, including existing data and any new updates. Two additional settings are now available to facilitate the acceleration of your…
This month, Event Schema Registry was introduced as a centralised resource for discovering, storing, and updating schemas for event-driven data flows. With this release, users can create and manage schemas within SchemaSets in Fabric Workspaces. August_2025_Fabric_Feature_Summary AI-generated content may be incorrect." /> Capabilities…
As part of our ongoing commitment to improving the SQL database in Fabric experience based on direct user feedback and workflow needs, we’ve introduced several new features to the query editor designed to streamline common tasks, enhance team collaboration, and offer greater flexibility when working between tools. Latest Improvements Bulk delete…
You can now read from and write to SQL databases in Microsoft Fabric using Python Notebooks, thanks to the new integration with the T-SQL magic command. This highly requested feature enables users to run powerful T-SQL queries directly within notebooks—combining scripting, visualizations, and explanatory text in one collaborative workspace. It…
Triggers in Fabric Data Factory pipeline allow you to automate your pipelines to run whenever events occur in Fabric such as file arrival, file delete, Lakehouse folder events, and pipeline events. Now to make management of your pipelines easy, we’ve added a panel on your pipeline that opens with the Trigger button from the pipeline canvas to view…
As we continue to evolve and expand the vision and capabilities of Fabric, we see many new and exciting use cases emerge from our incredible customer base. In Data Factory pipelines in Fabric, we’ve found many new ways to leverage pipelines that aren’t always directly related to data integration scenarios including business workflows and…
Incremental copy is one of the most loved features in Copy job. It dramatically boosts efficiency by transferring only new or updated data, saving you time, resources, and manual effort. The process is simple: the first run performs a full data load, and every run after that moves just the changes. Now you have greater flexibility in managing…
We’re on a mission to eliminate every friction point and make your data movement experience as smooth and intuitive as possible. Auto Table Creation is one of the steps in that direction. If the specified table doesn’t exist at your destination, Copy Job will automatically create the table and its schema for you. No manual setup, no interruptions,…
Copy job is the tool for you to move data from any source to any destination in any format. You can always choose binary copy between storage locations for any file format with highly optimized throughput. You can also copy files like CSV or Parquet to and from tables—and now, the same capability is available for JSON file formats.…
Saving a new Dataflow Gen2 with CI/CD support from a Dataflow Gen2 is now generally available. Customers often would like to recreate an existing dataflow as a new dataflow Gen2 (CI/CD), getting all the benefits of the new GIT and CI/CD integration capabilities. Today, to accomplish this, they need to create the new Dataflow Gen2 (CI/CD) item from…
For Dataflow Gen2 with CI/CD support, one of the most common experiences that you can have today when using a Dataflow is checking the results of its validation and the run operation. A few months ago, we introduced a new way to validate your Dataflow without ever leaving the Dataflow window, but for run operations you still had to go into the…
As part of our ongoing improvements, we've removed system folders from the navigator when selecting a folder for your SharePoint data destination. This enhancement streamlines your folder selection experience, ensuring only relevant user folders appear, reducing clutter and making it faster and more intuitive to pinpoint exactly where your data…
Discover templates faster and transform your workflow with our latest upgrade to the Template Gallery: category-based filtering! With this new feature, you can now browse templates by category—making it easier than ever to find exactly what you need when you need it. Whether you’re starting a new project, exploring solutions, or just curious about…
With the power of new get data Copilot capability supported in Dataflow Gen2, users can quickly connect to existing resources or set up new connections with ease. When you request Copilot to connect to a data resource, it first checks if the resource already exists. If found, dataflow gen2 can access and guide you through navigation and data…
Microsoft Fabric data mesh architecture supports organizing data into domains and sub domains, helping admins to manage and govern the data per business context with various delegated settings. Domains and sub domain structure enables data consumers to filter and discover content from the area most relevant to them. We have taken the data mesh…
To streamline discovery, the OneLake catalog now applies smarter default category selections based on your entry point. Power BI users are presented with the Insights category by default, which includes tools designed to facilitate data analysis, visualization, and reporting to support data-driven decision making. Fabric users will continue to see…
This integration brings a powerful new capability for agents to operate effectively across tools, redefining how organizations build, deploy, and scale intelligent agents across their enterprise data ecosystems. Data Agents in Fabric are AI-powered assistants that can synthesize enterprise data, understand data schemas, enforce governance…
The Data Source Instructions feature in Fabric’s Data Agent empowers users to deliver more accurate and relevant answers from their structured data. By allowing instructions to be scoped at the data source level, users can guide the AI on how to query specific tables, apply filters, interpret column values, or join datasets correctly. This…
The Data Agent now supports streaming results, allowing users to see live, incremental updates as their query is processed. Instead of waiting for the final answer, users can watch each step—like Data Source selection, query generation, and execution—unfold in real time. This provides faster access to partial results, greater transparency into how…
We’ve rolled out an enhanced run experience that makes it easier to follow how your query is processed from start to finish. This update includes improved naming for each run step, a cleaner visual layout, and streamlined backend execution. These changes make it simpler to understand the agent’s reasoning, while behind-the-scenes optimizations…
This intuitive and streamlined experience allows you to create rules at the desired level of data tracking. Whether you wish to monitor data at the event level or object level, you now have the flexibility to do so as you build your rule. One of the major improvements includes the automatic display of the rule definition pane once you connect to a…
With Activator, you can automate your business process like sending email or Teams alerts, running a notebook or pipeline, and executing Power Automate flows when certain data conditions are met. What’s new? One of the most popular actions is sending Teams messages. We are now expanding this functionality to enable the sending of alerts not only…
Activator enables you to automatically activate Fabric items like pipeline and notebook whenever certain data conditions are met. What’s new? Today, you can not only activate and execute Fabric items but also pass values to the parameters defined in your Fabric items. You can pass hardcoded values or dynamic values from the data source. With this…
Mirroring for Azure SQL Database with Virtual Network (VNet) Data Gateway and On-Premises Data Gateway (OPDG) are now generally available! Network security and secure data transmission are crucial for enterprise customers handling sensitive information. Using the VNet gateway or OPDG, you can mirror Azure SQL Database protected by a firewall with…
We've heard your feedback regarding the friction that upon pausing and resuming Fabric capacity, the mirrored database displays an inaccurate running status and requires a workaround to verify its actual state and to resume its functionality. We are pleased to update you that this experience has now been improved. Once Fabric capacity is resumed,…
In May 2025, we announced that you can configure the retention period for mirrored data via public API according to your needs. Now the setting is available on the UI as well. To check or update the retention setting, in the Fabric portal, navigate to your mirrored database -> Settings -> Maintenance tab as shown below, and specify the retention…
We’re excited to announce the preview of Azure Cosmos DB (NoSQL) in Microsoft Fabric, bringing globally distributed, low-latency, high-throughput data to the Fabric ecosystem. This integration allows developers and data teams to connect Cosmos DB directly to Fabric workloads like Lakehouses, Notebooks, and Power BI—unlocking powerful, real-time…
Incremental copy is one of the most popular features in Copy job, significantly improving efficiency by transferring only new or changed data—saving time and resources with minimal manual effort. When you select incremental copy, the first run performs a full data copy, and subsequent runs move only the changes. For databases, this means only new…
You can now choose to merge data directly into more destination stores including Fabric Lakehouse table, Salesforce, Salesforce Service Cloud, Dataverse, Dynamics 365, Dynamics CRM, and Azure Cosmos DB for NoSQL. These give you further flexibility to tailor data ingestion to your specific needs. Fabric_July_2025_Feature_Summary For more…
More source and destination connections are now available, giving you greater flexibility for data ingestion with Copy job. We’re not stopping here—even more connectors are coming soon! SFTP FTP IBM Db2 database Oracle Cloud Storage Dataverse HTTP Dynamics 365 Dynamics CRM Azure Cosmos DB for NoSQL Azure Files Azure Tables ServiceNow Vertica…
Previously, when trying to copy data from on-premises data stores into data warehouses like Snowflake or Fabric Data Warehouse, the Copy job UI would indicate that this scenario was not yet supported. That limitation has now been removed — it now works! The improvement comes from native support for staging copy. Behind the scenes, data is first…
Manual control for the auto-refresh feature in Data pipeline activities is now available. Previously, when you run your pipeline, the Output and Monitoring activity lists will refresh automatically for 5 minutes as demonstrated in the screenshot. Fabric_July_2025_Feature_Summary What’s new? When executing a pipeline, the Output and Monitoring tabs…
We are pleased to announce that Variable libraries have now been integrated with Fabric Notebooks and are available for preview. This new capability makes your Notebooks more modular, scalable, and environment-aware by letting you manage configuration values centrally—without modifying your code. Why This Matters…
Now in preview, Copilot Inline Code Completion (Preview) is an AI feature that assists data scientists and engineers in writing Python code more quickly and easily. Inline code completion makes your workflow smoother by helping you: Write code faster with smart, context-aware suggestions. Reduce errors and improve…
The T-SQL Notebook public preview launched last September and we've seen a fantastic increase in usage. Today, we are excited to announce the GA for this feature. Besides the features we released during the public preview, we also enhanced the monitoring experience of the T-SQL notebook by updating the Recent run…
Integrating T-SQL and Python in contemporary data workflows provides a robust and versatile methodology that leverages the advantages of both programming languages. In Microsoft Fabric Python notebooks, we are excited to announce the public preview of T-SQL magic command. This feature enables the execution of T-SQL…
The Fabric notebook history feature is now generally available. This feature is intended to enhance your experience in developing and managing notebooks by offering built-in version control capabilities. To begin, access the History control located in the upper right section above the Notebook ribbon:…
Creating a new notebook should be quick and easy—but flexible. Now instead of automatically generating a notebook with a default name in the selected workspace, we’ve made the process more user-friendly. When you are creating a brand-new Notebook, with this improvement you’ll be asked to: Name your Notebook for easy…
in (Preview) Materialized Lake Views , an advanced feature in Microsoft Fabric designed to streamline the deployment and management of the medallion architecture in Lakehouse, is now available in previe w across all regions . This feature allows users to define SQL-based Materialized Lake V iews over raw or…
Since the initial release of AI functions , we’ve continued iterating on the feature in response to your feedback. The latest round of updates makes AI functions easier to use, more powerful, and more cost-effective. We’ve upgraded the default model that powers AI functions to GPT-4o-mini, enhancing the feature’s…
Result set caching is in preview for Data Warehouse and Lakehouse SQL analytics endpoint. When enabled, this feature improves the performance of repetitive SELECT SQL queries by retrieving the cached result of the query’s first run, rather than re-processing the original query from scratch. If you have a reporting…
Register for a free, hands-on instructor-led Real-Time Intelligence in a Day workshop covering the capabilities of Real-Time Intelligence. This is an intermediate-level training course designed for users across all roles. Query Azure Monitor data in KQL Queryset We’re excited to share a major usability improvement in…
We’re excited to share a major usability improvement in KQL Queryset in Microsoft Fabric : it's now simpler than ever to query Azure Monitor data . While support for Azure Monitor resources has been available behind the scenes, it previously required manually configuring a connection string. With the latest update,…
A new method to build insights into Real-Time Dashboards has been introduced. Users can now use Copilot to write KQL queries directly within Real-Time Dashboards. This new capability brings the Copilot assistant pane into the tile editing experience, allowing you to ask questions about your data in natural…
Eventstream in Microsoft Fabric features no-code data transformation options for real-time processing, including filter, managed fields, aggregate, group by, join, union, and expand. These operators enable robust transformations via a drag-and-drop interface. Users can create simple and complex data processing rules…
Eventstream now includes support for multiple schemas. This feature allows you to infer multiple schemas from various sources and Eventstream itself, providing the ability to design different data transformation paths with flexibility. The support for multiple schemas in Eventstream enables the following scenarios,…
Eventstream's Confluent Cloud for Apache Kafka streaming connector is capable of decoding data produced with Confluent serializer and its Schema Registry from Confluent Cloud. The Confluent Schema Registry serves as a centralized service for managing and validating schemas used in Kafka topics, ensuring that producers…
Private Endpoints (MPE) support in Fabric Eventstream is now generally available. With this release, it is now possible to securely connect Azure Event Hubs and Azure IoT Hub to Eventstream using managed private endpoints in production environments. This feature enables Eventstream to pull data from Azure services…
The General Availability (GA) of the Azure Data Factory (Mounting) feature in Microsoft Fabric has been released. This feature allows customers to bring their existing Azure Data Factory (ADF) pipelines into Fabric workspaces seamlessly, without the need for manual rebuilding or migration. What’s new with GA Support…
An additional batch of Fabric public APIs for Deployment pipelines have been released, following our initial release of Deploy APIs a few months ago. With this new release, the full list of available Fabric APIs now matches the APIs available in Power BI, excluding Admin APIs, which will be added later. This marks a significant milestone in our…
Service Principal (SPN) support for Azure DevOps A few weeks ago, we announced the capability to use Service Principal when working with Fabric Git API and your Git Provider is GitHub. Soon, we will support Azure DevOps as your Git Provider as well. Cross-Tenant support for Azure DevOps Previously, connecting your workspaces using your identity to…
The preview of shortcut transformations introduces the ability to transform data as it’s shortcut into Fabric including changing the data format into Delta tables or applying AI transformations to unstructured data—such as summarizing text, translating content, or classifying documents.
After our preview launch , we have been working on increasing the number of regions supported for this feature. We have recently added the following 14 new regions where you can use this feature from: Australia Southeast Brazil South Canada Central Central India France Central Korea Central North Central US Norway East South Africa North South…
Fabric User data functions now support Service Principal Names (SPN) to run functions. This feature allows organizations to ensure compatibility with enterprise identity and access management systems. By using SPNs, it is possible to implement applications that can call a user data function without requiring user credentials. This aligns with the…
The Fabric Livy API for Data Engineering now supports Service Principal Names (SPN) to submit and execute Spark code. This added SPN authentication method allows organizations to ensure compatibility with enterprise identity and access management systems. By using SPNs, it is possible to implement applications that can call a user data function…
A new feature has been introduced: Private libraries support for Fabric user data functions. These private libraries are code created by you or your organization. Data engineering can be challenging, especially with data quality and complex analytics. Private libraries help streamline work and enable proprietary code use within a team securely.…
Fabric data agents can be used in the new chat with your data experience in Power BI to get answers to your questions and explore your data more effectively. This integration enables users in Copilot in Power BI to not only connect Power BI semantic models, but also to a wider range of data sources in OneLake—such as lakehouses, warehouses, and…
Fabric data agent will be available in preview and can be added as an agent to your custom setup in Microsoft Copilot Studio. With this integration, your custom agent can access data stored in Microsoft OneLake—including lakehouses, warehouses, Power BI semantic models, and KQL databases—and retrieve insights seamlessly through the Fabric data…
Are you ready to put your sleuthing skills to the test? The Kusto Detective Agency is back - and this time, it’s bigger, bolder, and packed with adrenaline. Fabric_May_2025_Feature_Summary AI-generated content may be incorrect." /> Introducing ‘Call of the Cyber Duty’ , a brand-new season of the Kusto Detective Agency challenge designed for the…
Get Data in Real-Time Intelligence Eventhouse offers a step-by-step process to guide you through importing or inspecting the incoming data, creating or editing the destination table schema, to exploration of the ingested result from multiple sources. One of the sources from which users can bring data into an Eventhouse table using Get Data wizard…
The Eventstreams feature in Microsoft Fabric Real-Time Intelligence allows you to bring real-time events into Fabric, transform them, and then route them to various destinations such as Eventhouse, without writing any code (no-code). You can ingest data from an Eventstream to Eventhouse seamlessly either from Eventstream artifact or using…
OneLake catalog is the central hub for discovering and managing Fabric content. One of the artifacts that OneLake catalog enables the discovery of is Microsoft Fabric Lakehouse, which is a data architecture platform for storing, managing, and analyzing structured and unstructured data in a single location. Fabric_May_2025_Feature_Summary…
Shortcuts are embedded references within OneLake that point to other files’ store locations without moving the original data. Previously, you could create a shortcut to OneLake delta tables using Eventhouse and query the data, but performance lagged direct ingestion in Eventhouse, as shortcut queries lacked the powerful indexing and caching…
Mirroring for SQL Server in Fabric for on-premises versions of SQL Server 2016-2022 is now in Preview! Mirroring in Fabric allows users to enjoy a highly integrated, end-to-end, and easy-to-use product that is designed to simplify your analytics needs. Built for openness and collaboration between Microsoft, and technology solutions that can read…
With the announcement of Microsoft SQL Server 2025 at Build, customers can also leverage mirroring from this version in Fabric. The overall user experience is like mirroring from other SQL Server versions and Azure SQL. Mirroring for SQL Server 2025 uses change feed instead of Change Data Capture and SQL Server keeps track and replicates the…
We have made substantial updates to Mirroring for Azure SQL Managed Instance in Fabric. Based on user feedback, new features have been developed to address data replication needs: Mirror Azure SQL Managed Instance via private endpoint: VNet data gateway or on-premises data gateway can be used as a way to connect to your Azure SQL Managed Instance…
Mirroring in Fabric continuously replicates your existing data estate from various databases into OneLake in Delta Lake table format. To keep the mirrored data efficiently stored and always ready for analytics, mirroring automatically runs vacuum to remove old files no longer referenced by a Delta log. We now offer you the flexibility to customize…
Mirroring now supports all regions that are available for workloads in Microsoft Fabric. We have recently added a new region support for West US 3 to meet the growing customer demand. For detailed information about the Fabric regions that support mirroring, please refer to the supported regions documentation.
Alongside the region expansion for all Mirroring in Fabric, Mirroring for Azure PostgreSQL will also expand region support from the initial 4 regions: Canada Central, West Central US, East Asia, and North Europe to all regions supported by Mirroring in Microsoft Fabric to ensure that customers have the best performance when replicating data from…
We’re thrilled to announce the latest refresh of Fabric Mirroring for Azure Cosmos DB ! This update introduces key enhancements like Microsoft Entra ID authentication, container selection, support for special characters in column names, and even vector search compatibility for AI workloads. With features like auto schema inference and full CRUD…
Cosmos DB is now available in preview as a new addition to the databases workload in Microsoft Fabric. Cosmos DB in Fabric is easy to set up, with automatic scale and secure by default, enabling you to build AI applications with less overhead. You can store and retrieve semi-structured data within milliseconds, without having to tweak the database…
Change Data Capture (CDC) in Copy Job is a powerful capability in Data Factory that enables efficient and automated replication of changed data including inserted, updated and deleted records from a source to a destination. This ensures your destination data stays up to date without manual effort, improving efficiency in data integration while…
Semantic Model Refresh activity for data pipelines is now generally available! With this activity, you will be able to create connections to your Power BI semantic model datasets and refresh them from your data pipeline! Fabric_May_2025_Feature_Summary AI-generated content may be incorrect." /> To learn more, refer to the Semantic model refresh…
Maintaining complex Data pipelines in your ETL project is not easy work, especially when you need to understand complicated Data pipelines created by others or you need to update some configurations for a set of pipelines. Copilot for Data pipeline helps users quickly understand the purpose of a pipeline and the details of its activities. With…
With this new set of features now generally available, you can seamlessly integrate your Dataflow with your existing CI/CD pipelines and version control of your workspace in Fabric. This integration allows for better collaboration, versioning, and automation of your deployment process across dev, test, and production environments. New Dataflow…
Data Factory in Fabric now provides a robust set of APIs that enable users to automate and manage their dataflows efficiently. These APIs allow for seamless integration with various data sources and services, enabling users to create, update, and monitor their data workflows programmatically. The APIs support a wide range of operations --…
Parameters in Dataflow Gen2 enhance flexibility by allowing dynamic adjustments without altering the dataflow itself. They simplify organization, reduce redundancy, and centralize control, making workflows more efficient and adaptable to varying inputs and scenarios. Fabric_May_2025_Feature_Summary Description automatically generated" />…
Incremental refresh for Lakehouse destinations in Dataflow Gen2 is now in preview! This feature introduces a powerful way to optimize performance and ETL pipeline for one of the most popular data destinations to date. With incremental refresh, users can ensure faster refresh cycles, improve system efficiency, and reduce resource consumption,…
SharePoint data destinations in Dataflows Gen2 is now in preview! This innovative feature empowers users to seamlessly write CSV files directly into their designated SharePoint sites, streamlining data integration and enhancing team collaboration within Office 365. Using this new capability, users can effortlessly configure their dataflow queries…
Copilot is now available within the Custom column dialog of Dataflow Gen2. You can leverage a new Copilot experience where you can have Copilot write a custom column formula based on a prompt that you provide. For example, for a table that has the fields **OrderID** , **Quantity** , **Category** , **Total** you can pass a prompt like the…
Fabric notebooks allow you to accelerate your productivity with native AI capabilities like Copilot and AI functions. A new notebook tab devoted to AI and ML tools now provides low-code shortcuts for transforming data with Data Wrangler, training custom models with AutoML, chatting with Copilot, and more. Among the updates is a low-code interface…
All Fabric notebook users have access to Data Wrangler , a low-code tool with an immersive interface for exploring and transforming pandas or Spark DataFrames. Data Wrangler provides a library of common data-cleaning operations that you can browse and apply seamlessly getting real-time previews and generating reusable code. We have new AI-powered…
There are two powerful new features in Fabric Warehouse that we are happy to introduce: ALTER TABLE DROP COLUMN and SP_RENAME COLUMN. ALTER TABLE DROP COLUMN effortlessly removes unnecessary columns to streamline storage, boost performance, and improve query efficiency. Cloning a table as of a point in time & time travel to a point in time that is…
Are you unable to manage intermediate query results efficiently in your batch jobs? Fabric Data Warehouse users can now create session-scoped #temp tables to handle these results seamlessly. These temp tables can be backed by either Parquet (distributed) or mdf (non-distributed), offering flexible options to cater to different needs. Users can…
The Migration Assistant for Fabric Data Warehouse is now in preview. The migration experience is built natively into Fabric and enables Azure Synapse Analytics (Data Warehouse) customers to transition seamlessly to Microsoft Fabric. This new DW migration experience allows users to easily migrate both metadata and data from the source database,…
The OPENROWSET function in Fabric Data Warehouse and Fabric SQL endpoint are generally available. The OPENROWSET function enables you to seamlessly read Parquet and CSV files stored in Azure Data Lake Storage and Azure Blob Storage, as it is shown in the following example: SELECT TOP 10 * FROM OPENROWSET( BULK…
The BULK INSERT statement in Fabric Data Warehouse is generally available, it enables you to ingest data into a table from the specified file path: BULK INSERT table_name FROM file_url_path The BULK INSERT statement is very similar to the COPY INTO statement and enables you to load data from external storage. The key value of BULK INSERT is that…
This challenge is specifically optimized for onboarding to the RTI platform. You can use it to enhance onboarding for customers and create CTF (Capture the Flag) tournaments to learn with hands-on experience. During this quest, you'll learn KQL and utilize powerful tools including: Eventstream : Process and transform real-time data Eventhouse :…
KQL Queryset has always supported cross-service queries, but now we’re making Azure data sources even more accessible. Application Insights (AI) and Log Analytics (LA) are now first-class citizens, just like Eventhouse and ADX, providing a more seamless and intuitive experience. With this update, you can: Run cross-service queries between Log…
We’re continuing to improve the low-code data exploration experience, making it even easier to analyze data in Real-Time Dashboard tiles and KQL Database tables (in Eventhouse and Real-Time Hub). Here’s what’s new: Hierarchal Columns Pane – easy to use summary of key data characteristics to guide exploration and data manipulation includes: List of…
As part of our ongoing commitment to improving system visibility, performance monitoring, and user experience, we've introduced several enhancements across both the Eventhouse System Overview and KQL Database in-item monitoring pages. Eventhouse system overview enhancements New - Eventhouse ingested rows overtime One of the improvements to the…
Last month, we introduced several powerful new connectors for Eventstream in Fabric Real-Time Intelligence. Now, we’re taking it a step further with a hands-on video that shows you how to use one of them: the Real-time Weather connector. Fabric_April_2025_Feature_Summary AI-generated content may be incorrect."> In the demo video, we walk through…
We have several new advances to share in SQL Database within Fabric. Continuous innovation is at the heart of our development, outlined are several key enhancements.
Australia Southeast Italy North Japan East Poland Central WestUS3 are new regions that supports SQL databases in Fabric workloads
SQL database in Microsoft Fabric offers automatic backups from the moment of database creation, ensuring data protection and recovery. The system makes full backups every week, differential backups every 12 hours and transaction log backups every 10 minutes, providing point-in-time restore capability up to 7 days. While compute and data storage…
The SQL in Fabric dashboard now shows the lead blocking query to allow developers to quickly identify SQL queries that are blocking and impacting other queries thereby disrupting their operational workloads. Link to Video .
This capability enables customers to automate, scale, integrate, and govern their SQL databases within Microsoft Fabric, using a declarative approach with Terraform. HashiCorp Terraform, an open-source tool that offers a secure, predictable, and consistent method for deploying and managing infrastructure across multiple cloud environments. This…
Fabric data pipelines will now support Fabric SQL database as a data source for Stored Procedure and Script activities, allowing users to just pick a database rather than having to enter connection information.
The query editor in SQL database in Fabric now have T-SQL support for graph databases. This feature enables the modeling of many-to-many relationships. You can create a graph database with nodes and edges and utilize the new MATCH clause to identify patterns and navigate through the graph. Learn more about how to Create a graph database and run…
We are thrilled to announce a major update in Microsoft Fabric! Starting today, the SKU requirement for Copilot and AI features will be lowered to F2, making it much more accessible for you to explore, test, and utilize Fabric AI capabilities. This exciting change grants you full access to Copilot in Fabric, Fabric data agents, and Fabric AI…
You now can mirror Snowflake protected by a firewall. Using either the VNet data gateway or the on-premises data gateway for mirroring is available. The data gateway facilitates secure connections to your source databases through a private endpoint or from a specific private network. Learn more about Mirroring for Snowflake from the Microsoft F…
We are excited to announce the upcoming preview of a new CI/CD feature - Variable library item in Microsoft Fabric. This feature is designed to provide a unified and centralized way to manage configurations, reducing the need for hardcoded values and simplifying your CI/CD processes, making it easier to manage configurations across different…
In addition to Variable library, the CI/CD platform is releasing a few important updates to improve the developer experience when setting up your CI/CD process in Fabric. Service Principal support The following set of APIs will start supporting Service Principal as well: Deployment pipelines APIs GitHub (through Git APIs) Calling Git APIs when…
Our amazing Fabric partners are delivering new capabilities fully integrated with Fabric as Workloads ! This allows for the creation of new item types in shared workspaces for team collaboration. The Workload Hub is Fabric’s in-product marketplace for Partners that natively integrated with Fabric to provide our community with the ability to try…
Tags in Fabric enable flexibility in how you structure and manage your data estate and are now generally available. By providing the ability to apply additional metadata to items in Fabric, tags help admins and data owners categorize the data, enhancing the searchability and boosts success rates and efficiency for end users.…
Microsoft Fabric’s data mesh architecture supports organizing data into domains & sub domains helping admins to manage and govern the data per business context with various delegated settings. Domains & sub domains structure enables data consumers to filter and discover content from the area most relevant to them. We have improved the visibility…
It’s now even easier than ever to work with your Fabric data in Excel! The OneLake catalog is now integrated into the Modern Get Data experience in Excel, allowing users to effortlessly discover and connect to their Lakehouse or Warehouse assets . With just a few clicks, you can bring Fabric data into Excel for analysis and decision-making. This…
Navigating through your data just got more efficient! Our new enhanced search capability allows users to search for sub-items such as tables, columns, and measures directly within their data items . This search functionality is available for users after they click on a specific item, ensuring quick access to relevant information without…
To optimize workflows, you can now quickly open an item editor or viewer with a single click through a dedicated quick action instead of navigating to the Item Details page first. This improvement speeds up access to frequently used items and enhances productivity for all users. Fabric_March_2025_Feature_Summary AI-generated content may be…
Security teams can use DLP policies to meet security and compliance requirements for sensitive data in the cloud. These policies leverage content scan to automatically detect the upload of sensitive information, and to trigger risk remediation actions (such as policy tips, audit logs and alerts) in semantic models and lakehouses. DLP policies…
Support for multi-tenant organizations in Fabric is now generally available (GA). Entra ID users of type external member are supported across the Fabric platform. Users can authenticate, bring their own licenses from their home tenants and use Fabric workloads for development and consumption. There are some limitations when using Fabric with an…
We are pleased to announce the addition of writing capabilities with the Fabric Spark connector for Fabric Data Warehouse (DW) in the Fabric Spark runtime. This connector utilizes a two-phase write process to a Fabric DW table. Initially, it stages the Spark dataframe data into intermediate storage, followed by the COPY INTO command to ingest the…
Esri is recognized as the global market leader in geographic information system (GIS) technology, location intelligence, and mapping, primarily through its flagship software, ArcGIS. Esri empowers businesses, governments, and communities to tackle the world's most pressing challenges through spatial analysis and location insight. We are pleased to…
The Spark Job Definition now supports the Deployment Pipeline. With this update, you can easily deploy your SJD (Spark Job Definition) item across different stages (Development, Testing, Production) and ensure that the proper state of the SJD item is synchronized across these stages. You can also customize the deployment with deployment rules to…
We are pleased to announce the introduction of row and column level security for Spark within Microsoft Fabric. This update significantly enhances data governance by incorporating fine-grained security controls within Spark. Access control policies are established in OneLake security by specifying limiting factors for rows and columns in…
Python developers using Fabric Notebook can now take advantage of Pylance , a powerful and feature-rich language server, to enhance their coding experience. With context-aware completions, better error detection, and improved code insights , Pylance makes PySpark and Python development smoother and more productive. Key Improvements with Pylance…
You can now attach Environments from different workspaces in your Notebooks and Spark job definitions! This is made effortless with a brand-new explorer! Easily manage and utilize resources across multiple workspaces by exploring Environments from the workspaces you own, have access to, or that are shared with you by others.…
Git and Deployment Pipelines support for Lakehouse objects is a top ask across all our customer base, and we are excited to announce that now Shortcuts definitions under the Tables and Files section of lakehouse are supported in the Fabric Git/ALM platform. This is an exciting milestone, allowing customers to version and orchestrate Shortcuts…
Fabric User Data Functions is a serverless platform that gives app developers and data engineers the ability to easily write and run applications on Fabric. User Data Functions empowers you to implement custom logic wherever you need to in your Fabric ecosystem by leveraging native integrations with Fabric data sources, Fabric Notebooks and Data…
The Spark SQL FSCK REPAIR TABLE command and fast OPTIMIZE for V-Order are now available on Fabric Runtime 1.3 (Spark 3.5 / Delta 3.2). FSCK is designed to safely remove missing parquet files from the Delta transaction log, to restore table read consistency. This is not data recovery functionality, the missing parquet files and the data contained…
We’ve received valuable customer feedback emphasizing the need for API support to automate Spark job submission and monitoring. In response, we’re excited to introduce the preview of Fabric Spark Monitoring APIs—a robust set of tools designed to enhance observability and streamline the monitoring and management of Spark applications within…
Introducing the preview of Notebook integration with User Data Functions (UDFs)! This new capability allows you to define custom logic and calculations that can be reused across multiple Notebooks, helping streamline workflows and enhance code modularity. With NotebookUtils, you can now seamlessly access and invoke UDFs directly from your Notebook…
The Copilot in Notebooks Agentic enhancement has introduced several significant improvements aimed at enhancing the user experience and productivity. One of the key enhancements is the enhanced conversation history , which allows users to maintain context and continuity in their interactions. Additionally, there have been chat and natural language…
Since the launch of AI skill in August 2024, we’ve improved conversational abilities, support for multiple data sources and so much more. To better reflect these enhanced agentic capabilities, AI skill is now Fabric data agent !
We’re thrilled to announce that we are removing the SKU requirement to access Copilot and AI capabilities across all paid SKUs. This means that customers on F2 and above will be able to use Copilot and AI features, such as Copilot in Power BI and Fabric data agent, to streamline workflows, generate insights, and drive impactful decisions.
We are excited to launch the integration of data agents in Fabric with Azure AI Agent Service from Azure AI Foundry. A critical component of Azure AI Agent Service is the ability to securely ground AI agent outputs in enterprise knowledge, ensuring responses are accurate, relevant, and contextually aware. Data agents in Fabric can retrieve…
We are pleased to announce the preview of the Fabric data agent Python SDK. The Fabric data agent Python SDK library is a powerful tool designed to streamline the development and prototyping of AI assistants on the Fabric platform. It is intended for users who are looking to create, manage, and utilize Fabric data agents programmatically. The…
AI functions are now available in private preview for Data Warehouse and Lakehouse SQL Endpoint , making it easier to bring AI-driven insights directly into your SQL workflows. With these built-in functions, you can summarize content, translate text, extract key data, analyze sentiment, and more - right from T-SQL . This eliminates the need for…
Scalar Fabric functions are now available in private preview for Data Warehouse and Lakehouse SQL Endpoint , giving you the flexibility to extend SQL capabilities beyond built-in functions. With this feature, you can write custom functions in Python (and soon other languages) and invoke them directly through T-SQL , just like regular scalar…
Scalar SQL User-Defined Functions (UDFs) are now available in private preview for Data Warehouse and SQL analytics endpoint . Scalar SQL User-Defined Functions (UDFs) are a cornerstone of T-SQL programming, widely recognized and utilized for their ability to encapsulate business rules and calculations into a reusable code . This feature offers an…
IntelliSense for Collate Clause The COLLATE clause in Microsoft Fabric Warehouse and the SQL Analytics Endpoint of Lakehouse (LH) is essential for managing text-based data processing, ensuring accurate sorting, filtering, and comparisons. Given that Warehouse, SQL Analytics Endpoint of LH and other items support variations of case-insensitive and…
These IntelliSense and grammar updates make working with OPENROWSET, JSON more seamless and efficient. With improved syntax highlighting, and query validation , SQL development is now faster and more error-free . Live templates Writing T-SQL queries efficiently is crucial for database developers. Live Templates are predefined code snippets that…
We are excited to announce that SQL audit logs are now in preview in Microsoft Fabric Data Warehouse ! Audit Logs provide a detailed record of warehouse activity, capturing essential information such as when events occur, which triggered them, and the T-SQL statement behind the event. This feature is crucial for security and compliance, helping…
We are thrilled to announce the introduction of enhanced sharing capabilities in Microsoft Fabric Data Warehouse! With these new updates, you can now grant additional permissions to monitor queries and audit activities, providing deeper visibility into warehouse operations. These enhancements allow organizations to delegate access more…
As data governance becomes more central, we're thrilled to introduce OneLake Security for SQL Analytics Endpoints , now available in Private Preview ! This powerful capability simplifies how security is enforced in Microsoft Fabric by letting you configure access once in OneLake , and have that security respected across your SQL workloads. With…
Eventstream is a powerful feature in Fabric Real-time Intelligence that allows users to ingest, transform, and route real-time data streams to various destinations within Fabric. We are excited to announce the addition of five new sources and additional sample data streams. These new sources enhance Eventstream's streaming capabilities, enabling…
Collaborating on data streaming solutions can be challenging, especially when multiple developers work on the same Eventstream item. Version control challenges, deployment inefficiencies, and conflicts often slow down development. Since introducing Fabric CI/CD tools for Eventstream last year, many customers have streamlined their workflows,…
Managed Private Endpoint (MPE) is a Fabric platform security feature that allows Fabric items, such as Eventstream, to securely connect to data sources behind firewalls or protected networks. Since we introduced this integration last year, many customers have relied on it to establish secure outbound connections between Eventstream and their data…
We’re excited to introduce Microsoft Entra ID authentication for Eventstream’s Custom Endpoint! This feature enhances security by eliminating the need for SAS keys or connection strings, reducing the risk of unauthorized access. Instead, Entra ID authentication ensures that user permissions are directly tied to Fabric workspace access , allowing…
Transforming data in Eventstream requires an actual schema derived from incoming data, which can slow down development and troubleshooting. To simplify this process, we are excited to introduce Data preview , a major usability enhancement for third-party connectors in Fabric Eventstream, including Apache Kafka, Confluent Cloud, Amazon Managed…
There are a few different methods to get data into the Real-Time Intelligence workload, depending on your organization’s needs. Data can be pushed or pulled into an Eventstream from one of the many connectors and then landed in an eventhouse. Alternatively, there are several ways to directly ingest data into Eventhouse. Data can be directly from:…
Azure and Fabric Events , a powerful capability that allows organizations to capture, process, and respond to events across Microsoft Fabric is now generally available. With these events, businesses can integrate event-driven solutions into their workflows, enabling seamless automation, enhanced observability, and faster decision-making.…
Eventhouse OneLake availability allows creating a delta parquet representation of data in Eventhouse. Previously, when you turned availability ON, only new data was made available in OneLake, with no backfill of existing data. This could cause inconsistencies between the data in Eventhouse and OneLake. Now, OneLake Availability supports backfill,…
We’ve made it easier than ever to create and manage Activator alerts on your Power BI reports. We’ve redesigned the Power BI ‘Set Alert’ experience so that you can conveniently manage your alerts entirely within your reports, without having to open Activator. We’ve also streamlined the experience so that you can set up an alert with fewer steps.…
We are excited to announce a brand new RTI sample experience which allows you to create a fully working end-to-end RTI flow within seconds. The sample flow allows you to explore the main features of Real-Time Intelligence with sample data. It provides a comprehensive end-to-end solution, demonstrating how Real-Time Intelligence components work…
The next generation of Azure Synapse Data Explorer offering is evolving to become Eventhouse , part of Real-Time Intelligence in Microsoft Fabric. For customers looking to migrate to Eventhouse, we are providing a migration tooling that allows you to seamlessly migrate Synapse Data Explorer cluster to an Eventhouse in Fabric. The migration process…
Managing granular data security across multiple applications and analytics engines is complex, often leading to either excessive restrictions or accidental exposure. That’s why we’re introducing OneLake security as a breakthrough in data protection. With OneLake security, you define access once, and Fabric enforces it consistently across all…
OneLake shared access signatures (SAS) are now generally available (GA)! OneLake SAS tokens provide secure-short-term, delegated access to your resources in OneLake, helping you share or distribute data through scoped-down SAS tokens. SAS tokens and user delegation keys are always backed by a Microsoft Entra identity and always limited to a 1-hour…
You now can mirror Azure SQL Databases protected by a firewall. Using either the VNet data gateway or the on-premises data gateway for mirroring is available. The data gateway facilitates secure connections to your source databases through a private endpoint or from a specific private network. Learn more about Mirroring for Azure SQL Database from…
Database Mirroring now supports replication of your Azure Database for PostgreSQL Flexible Server into Fabric! Now you can continuously replicate data in near real-time from your Flexible Server instance to Fabric OneLake. This enables seamless data integration, allowing you to leverage Fabric’s analytics capabilities while ensuring your…
We’ve made improvements to our end-to-end in-product experience for Open Mirroring. With these changes, you can now create a Mirror DB and start uploading or dragging and dropping parquet and CSV files. It’s now easier than ever to get started with building your own Open Mirror source and allow you to test our replication technology before…
In November 2024, we announced the preview of 3 innovative capabilities in Copilot for Data Factory (Data pipeline). Today, we are excited to make these features generally available, with enhancements to make your data integration even more efficient and effortless. Check out the blog post on Efficiently build and maintain your Data pipelines with…
We are thrilled to share the significant updates and newly released workloads for this month, showcasing the incredible efforts and innovative work by our amazing partners.
Osmos AI Data Wrangler Automate Data Ingestion with Osmos AI Data Wrangler for Microsoft Fabric As enterprises scale AI adoption, they must ensure all their data is AI-ready . However, enterprise data is often messy - semi-structured or unstructured, arriving in inconsistent formats from customers, partners, suppliers, and internal systems.…
Microsoft Fabric in collaboration with PowerBI.tips, are excited to share that Power BI Designer is now generally available ! You won’t want to miss out on this time saving application. Say goodbye to bland, cookie-cutter reports and hello to dazzling, highly stylized masterpieces. What’s Power Designer All About? Power Designer is sleek,…
Profisee has introduced the first native Master Data Management (MDM) workload within Microsoft Fabric , seamlessly integrating its MDM platform into Fabric’s environment. This breakthrough allows users to manage and unify enterprise data without leaving the familiar Fabric interface. Get it now: Profisee MDM Workload for Microsoft Fabric . By…
The Lumel Fabric workload is now in preview. PowerTable allows business users to build no-code, writeback-enabled table apps on Microsoft Fabric. It connects LIVE (with bi-directional sync) to your cloud data warehouse tables in platforms such as Fabric SQL, Fabric Data Warehouse, Azure SQL, Databricks, Snowflake, Amazon Redshift, Google BigQuery,…
Announcing SAS Decision Builder in preview, a new workload from longtime Microsoft partner and analytics vendor SAS. This powerful SaaS solution is designed to help organizations automate, optimize, and scale their decision-making processes in real-time, whether they are managing complex business rules, integrating machine learning models, or…
Microsoft Fabric’s robust ecosystem empowers partners to integrate custom capabilities through the Fabric Workload Development Kit. Striim proudly introduces a Fabric workload designed for real-time data ingestion, processing, and AI-driven analytics—delivering seamless integration, scalability, and actionable insights. The Striim workload builds…
Customers often would like to recreate an existing dataflow as a new dataflow Gen2 (CI/CD), getting all the benefits of the new GIT and CI/CD integration capabilities. Today, to accomplish this, they need to create the new Dataflow Gen2 (CI/CD) item from scratch and copy-paste their existing queries or leverage the Export/Import Power Query…
Incremental Refresh for Dataflow Gen2 is now generally available! Incremental Refresh for Dataflow Gen2 allows you to refresh only the buckets of data that have changed, rather than reloading the entire dataset on every dataflow refresh. This not only saves time but also reduces resource consumption, making your data operations more efficient and…
When you click Save & run in Dataflow Gen2 with CI/CD support, the process that gets triggered is two-fold: Validation : it’s a background process where your Dataflow gets validated against a set of rules. If it passes all validations and no errors are returned, then it’ll be successfully saved. Run : Using the latest published version of the…
You can now add Dataflow refresh activities to your pipelines in Fabric Data Factory that include the new version of Dataflows: Fabric_March_2025_Feature_Summary AI-generated content may be incorrect."> Check out our documentation on Dataflow Gen2 with CI/CD and Git integration to learn more.
Enhancing your Data Integration experience What are Parameterized Connections? Parameterization of data connections in Data pipelines allows you to specify values for connection placeholders dynamically. This means you can pre-create data connections for various sources, such as Azure Blob Storage, SQL Server or any other data source supported by…
In Dataflow Gen2, you can create parameters , they serve as a way to easily store and manage a value that can be reused throughout your Dataflow. Major feedback that we’ve heard from our users is the lack of this capability in the Data destination experience for Dataflow Gen2. Thanks to the feedback, we’re now introducing the first support for…
The Apache Airflow job in Microsoft Fabric is now generally available, providing a fully integrated Apache Airflow runtime for developing, scheduling, and monitoring Python-based data workflows using Directed Acyclic Graphs (DAGs). What's New: Introducing Fabric runtime versioning for Apache Airflow job – This includes Fabric runtime version 1.0,…
The Fabric Data Factory team is thrilled to announce that the pipeline trigger experience is now generally available (GA) and now includes access to files in OneLake! Fabric_March_2025_Feature_Summary Description automatically generated"> This exciting new improvement to pipeline triggers in Fabric Data Factory means that you can now automatically…
One of the most requested features in Fabric Data Factory has been support for modifying values when deploying workspace changes between environments using Fabric CICD. To accommodate this, ask, we have integrated pipelines into the new Fabric platform feature called Variable Libraries . Fabric_March_2025_Feature_Summary AI-generated content may…
The Spark Job Definition (SJD) activity in Data Factory allows you to create connections to your Spark Job Definitions and run them from your data pipeline. And we are excited to announce that parameterization is now supported in this activity! You will find this update in the Advanced settings where you can configure your SJD parameters and run…
Parameterizing data pipelines to support generic reusable pipeline models is extremely common in the big data analytics world. Fabric Data Factory provides end-to-end support for these patterns and is now extending this capability to the Azure Databricks pipeline orchestration activity. Now when you select ‘Jobs’ as the source of your ADB action,…
User Data Functions are now available in preview within Data pipeline's Functions activity. This new feature is designed to enhance your data processing capabilities by allowing you to create and manage custom functions tailored to your specific needs. Fabric_March_2025_Feature_Summary Description automatically generated"> Key Highlights Custom…
We’ve increased the default activity limit from 80 activities to 120 activities! You can now utilize an additional 40 activities to build more complex pipelines for better error handling, branching, and other control flow capabilities. Fabric_March_2025_Feature_Summary Description automatically generated">…
CI/CD and REST APIs support is now available for the Azure Data Factory item (Mounting ADF).
The mirrored database’s CI/CD support is now Generally Available. Learn more from CI/CD for mirrored databases . The REST APIs support has been Generally Available including the SPN support. Check out our documentation on Mirroring Public REST APIs.
The Copy job item’s CI/CD and APIs support is now Generally Availability. This includes SPN support for Copy job. Check out our documentation on CI/CD for Copy job to learn more.
Support for data pipeline functionality on the VNet data gateway is now available in preview. The VNet data gateway facilitates connections to data sources that are either behind firewalls or accessible within your virtual network. This feature enables the execution of data pipeline activities on the VNet data gateway, ensuring secure connections…
As a developer and data source owner, you can create connectors using the Power Query SDK and have them certify through the Data Factory Connector Certification Program . Certifying a Data Factory connector makes the connector available publicly, out-of-box, Microsoft Fabric Data Factory and Microsoft Power BI in the following experiences This…
Copy Job is making data ingestion simpler, faster, and more intuitive than ever and is now generally available. Whether you need batch or incremental data movement, Copy Job provides the flexibility to meet your needs while ensuring a seamless experience. Since its preview last September, Copy Job has rapidly evolved with several powerful…
The 32-bit version of Power BI Desktop will no longer be supported after 6/30/2025. Upgrade to the 64-bit version Power BI Desktop to keep receiving updates and support.
To continue using Report view Copilot chat pane, you will need to upgrade to February 2025 version. Report view Copilot chat pane might not work as expected for versions before February 2025 after 4/30/2025.
Copilot support is now available in the Power BI Mobile apps on iPads and Android tablets, extending the functionality of AI to more mobile devices. Introduced a few months ago for phones , Copilot in the Power BI Mobile apps empowered users to quickly analyze data, gain insights, and make informed decisions on the go. Now, the same powerful…
We’ve heard an overwhelming amount of feedback that users would like more transparency into how Copilot generates visual answers. This month, we’ve revamped our previous ‘show reasoning’ section to a new detailed section we’re calling ‘How Copilot arrived at this’. When receiving a visual answer from Copilot, expand this new section to dig into…
Sometimes in Copilot, you may want to do a bit more with the visual answer, like drill down, filter it further, maybe even swap it to a different visual type. Until now, the only way to take action on the Copilot generated visual was to add it to the page. This of course was limited to ‘edit mode’ only. But we have great news! This month we’ve…
Another month, more updates to visual calculations. This month we are introducing another customer request: support for conditional formatting! You can now use visual calculations to set up conditional formatting rules for columns and measures on your visuals. Also, you can now apply condition formatting rules to visual calculations. Once you open…
We’re excited to announce that Azure Maps support for Publish to Web reports is rolling out. With this update you don’t need to take any extra steps to take advantage of your Azure Map visuals in Publish to Web reports. Just get your embedded code as you normally would using the Publish to Web (public) option under the Embed Report section of the…
Improved modeling performance We have significantly enhanced the modeling performance for live editing of Direct Lake semantic models using Power BI Desktop. Upgrading to the latest version will result in at least a 50% improvement in each modeling change. More details on the feature, including requirements, considerations, and limitations can be…
We sincerely appreciate your trial and feedback on the new Snowflake connector released as preview in January. This month, we have enhanced this connector with performance improvements and bug fixes to provide a smoother experience. We invite you to upgrade to the latest version to evaluate these enhancements. Learn more about the Snowflake…
This month, we are introducing a new option for getting data from the Vertica database using the official Vertica ODBC driver, currently available in preview. This feature allows you to take advantage of the native client tool provided by the data source. More details about this feature, including the driver installation and configuration…
Donut PRO is more than just a beautiful and customizable donut chart visual. It is also a way to instantly make your reports more interactive and user-friendly. Simply click directly on a slice to drill down a level and reveal more details. Donut PRO will also seamlessly cross-filter with other visuals, allowing users to quickly filter data and…
The Powerviz Heatmap visualizes data density and value distribution using color gradients, transforming complex datasets into an intuitive matrix format. It is ideal for identifying patterns, correlations, and outliers, aiding data-driven decision-making. Key features: Shapes : Choose from Default, Fixed, or Diverging built-in shapes. Data colors…
Unlock the power of seamless masterdata management with accoMASTERDATA for Power BI. Streamline your data processes and enhance your writeback capabilities for smarter business decisions. Key features: Effortless writeback : Easily configure writeback to SQL and FABRIC databases. Track changes in a dedicated log for full transparency. Full control…
The OneLake catalog is now integrated into the Power BI app experience in Microsoft Teams, enabling seamless data discovery and exploration within the Microsoft Office ecosystem. This integration empowers business users and professionals to interact with their data - explore it, take actions, and more - all without leaving Teams.…
In Fabric Monitoring Hub, you can centrally monitor Microsoft Fabric activities. It displays refresh activities for all semantic models, each showing one line with the status of the last refresh. Fabric_February_2025_Feature_Summary AI-generated content may be incorrect."> Previously, clicking on an activity name in the Monitoring Hub directed you…
Timeline update - Folder support is planned to roll out to all customers by mid-April. Thank you for your patience! This update ensures that the folder structure in your Fabric workspace is seamlessly mirrored in your connected Git branch, providing an organized and consistent experience across both platforms. Microsoft_Fabric_January_2025_update…
Announcing the preview of the highly anticipated Python Notebook! This new feature is designed to enhance the experience of BI developers and data scientists working with smaller datasets using Python as their primary language. Key features: Native Python support: Enjoy the full power of Python with native features and libraries right out of the…
Announcing the launch of the Fabric notebook version history feature. This new feature is designed to significantly improve your experience in developing and managing notebooks by providing robust built-in version control capabilities. Highlights: Automatic checkpoints: These checkpoints are created automatically every 5 minutes , ensuring that…
Introducing a new utility in NotebookUtils- session management utilities, including a list of APIs that can help you manage your session and interpreter status. notebookutils.session.stop(): Support stopping the interactive session via code, it's available for Scala and PySpark. notebookutils.session.restartPython(): Support restarting the Python…
Introducing a new update that simplifies enabling the Native Execution Engine. Now, activating it is as easy as toggling a switch! You’ll find the new toggle button in the Acceleration tab within your environment settings. Microsoft_Fabric_January_2025_update If you were previously using the Native Execution Engine, please navigate to the…
The latest Native Execution Engine on Fabric Runtime 1.3 introduces legacy timestamp handling, ensuring compatibility across Spark versions. This feature addresses timestamp issues caused by Spark 3.0’s shift to the Java 8 date/time API (Proleptic Gregorian calendar) from the previous hybrid Julian-Gregorian calendar. With the configuration…
The service principal support for Fabric API was announced back in September . Today, we unblock another key scenario, enabling run the Notebook/Spark Job Definition execution under SP (service principal) for Data Engineering experience. Using the Fabric Job Scheduler API , users can trigger the execution of either a Notebook or Spark Job…
A new improvement to the lineage related to Spark Notebooks has been introduced to enhance data exploration effectiveness. You can now view all Lakehouses connected to your notebook, including pinned and additional Lakehouses. This update helps you: Perform Impact Analysis: Easily assess how changes affect data workflows by identifying which…
The COPY statement offers flexible, high-throughput data ingestion from an external Azure storage account into Fabric Data Warehouse tables. When there is a column count mismatch between rows in source files and the target table, COPY INTO has the following behavior: If a row within the source files has less columns than the target table, COPY…
One of the challenges our customers shared is that executing COPY INTO command requires users to have at least the Contributor role at the workspace level, granting broad permissions that may exceed what is necessary for specific tasks. We are excited to announce that now a user with minimum ‘read’ permissions on the control plane will be allowed…
We are happy to announce the ability to change the default schema in Fabric Data Warehouse. With this improvement, which has been highly requested by our customers, we strive to make database management and enhanced security more straightforward. This is done using the ALTER USER statement, ensuring that every user has a predefined schema context…
New features have been introduced to provide deeper insights into query performance. With the introduction of Data Scanned Analysis , you can now determine if large data scans are contributing to slower query execution. This feature allows you to compare similar queries, pinpoint fluctuations caused by changes in data scanned, and even identify…
The Preview for SHOWPLAN_XML in Microsoft Fabric Data Warehouse is now available. This capability allows users to generate and view the estimated query execution plan in XML format, a tool for analyzing and optimizing SQL queries. Whether you're troubleshooting performance bottlenecks or refining query strategies during development, SHOWPLAN_XML…
Along with SHOWPLAN_XML, we are announcing support for some query hints. Query hints in Fabric SQL are optional keywords that can be added to SQL statements to provide additional information or instructions to the query optimizer. These hints can improve the performance, scalability, or consistency of queries by overriding the default behavior of…
The search and filter features in Fabric Data Warehouse empower users to efficiently navigate and manage their data. Microsoft_Fabric_January_2025_update The new search feature is designed for ease of discovery and intuitive use, allowing users to locate objects in the object explorer by entering keywords. The search function quickly highlights…
Developers now can easily access their Fabric Warehouse through their preferred client tools. With a renewed focus on integrating with widely used developer tools, this enhancement prioritizes flexibility and convenience, enabling seamless connections with SQL Server Management Studio and Visual Studio Code . This means you can dive right into…
The Git artifact status bar offers a comparable experience to the status bar in the workspace. When accessing the DW item page, you can view the details of the connection between the workspace and the Git repository, such as: The name of the branch to which the workspace is connected The time of the last sync event between the workspace and the…
Fabric Web editor provides robust tooltip support for built-in functions, enhancing the development experience by offering quick access to function details. When you hover over a built-in function in your query, web editor displays an interactive tooltip. This tooltip includes the function’s name, possible parameters, and a brief description . For…
Our goal is to facilitate Fabric developers in writing queries by enabling new T-SQL statements in Fabric Warehouse. Recently, we have integrated IntelliSense support for the following newly released features. FOR JSON - Announcing improved JSON support in Fabric DW COPY INTO – Column count check: COPY INTO (Transact-SQL) - Azure Synapse Analytics…
As part of our ongoing enhancements to JSON functionalities in Fabric DW , we are excited to announce the preview of two new JSON aggregate functions: JSON_OBJECTAGG JSON_ARRAYAGG These aggregate functions simplify the process of concatenating columns within a GROUP BY operation and formatting them as JSON text.…
Spatial analytics functions are now fully supported in Fabric DW and SQL endpoints. Spatial functions enable you to perform complex calculations on the geographical and geometrical shapes, such as determining the distance between points, checking whether a point is within a polygon, or whether the shapes intersect. Previously, these functions were…
We released an update to the SQL analytics endpoint that improves query performance and data freshness. Previously you might have encountered slow SELECT statements and stale data in your tables. With this update, metadata changes are synced more efficiently to the SQL analytics endpoint, resulting in faster SELECT query execution and data…
Late arrival tolerance refers to how long Activator waits for an event to arrive and be acknowledged and processed. This setting ensures that late events and events that arrive out of order have an opportunity to be included in the rule evaluation. The consideration is to tradeoff on getting more ‘accurate’ rule evaluations by waiting longer for…
As of November 2024, Real-time Intelligence and Activator are now Generally Available (GA)! You may need to work with your admin to ensure that you have all the capabilities available to you in Activator GA. If your tenant is using the preview version of Data Activator but does not have Fabric enabled, you will no longer be able to create new…
Application Lifecycle Management (ALM) and Fabric REST APIs are now available for all RTI items: Eventstream, Eventhouse, KQL Database, Realtime dashboard, Query set and Data Activator. ALM includes both deployment pipelines and Git integration, both allow you to manage change within your workspaces. This enables multiple scenarios, from simply…
We are expanding the details view of Semantic Models, to also include table and column descriptions which were set in the data model editor in the service or in Power BI Desktop. The goal is to provide consumers with multiple trust signals regarding an artifact, thereby enabling them to make swift and well-informed decisions. This improvement…
You now have a dedicated filter for workspace names, which will allow you to quickly locate the required workspace. This makes it easier for users with access to multiple workspaces, and makes finding the relevant workspace difficult if it isn't featured at the top of the list. Microsoft_Fabric_January_2025_update
We are excited to announce the preview of Tenant Level Private Link for SQL database in Fabric! This new feature enhances the security and privacy of your data by allowing you to connect to your SQL database through a private endpoint within your virtual network. With Private Link, you can now ensure that your data traffic remains within the…
Copilot for SQL database is now available in all supported regions listed in Fabric region availability! Today, we are offering three key features: Inline Code Completion for faster, smarter query writing. ‘Explain the Query’ & ‘Fix Query Error’ Quick Actions to simplify complex tasks. Sidecar Q&A Chat for answers and deeper understanding. Before…
Unlock suggested questions from standard prompts in Copilot When launching Copilot or using the prompt guide, you can select from standard prompts. In preview mode, a new prompt ‘Answer a question about the data’ will be available coming end of January. Selecting this prompt will unlock 3 suggested questions to help you explore your data. You can…
Explore this data: new entry point from a visual Exploring your data is easier than ever, now that we’ve added an Explore this data option to the visual options menu. This lightweight and focused experience allows users to launch Explore and easily tweak their visual (change chart type, add new data, filter, and more!) and see the underlying data,…
Following the November 2024 Text slicer release, this update enhances functionality and user experience by allowing multiple text selections. The Text slicer is currently in preview. To enable the Text slicer , go to Options and settings > Options > Preview features > Text slicer visual to make sure it is selected, then restart Power BI. This…
Semantic model version history (Preview) Announcing the public preview of semantic model version history coming this month. This feature aims to empower self-service users by providing confidence to recover from critical mistakes when editing semantic models on the web. In this preview, versions will be automatically captured in an Office-like…
New Snowflake connector implementation (Preview) We continue to enhance the integration with Snowflake. This month, we are introducing a new implementation for Snowflake connector, currently available in preview. To access this feature, in Power BI Desktop, navigate to Options and settings (under the File Menu) > Options > Preview features ,…
Drill Down Scatter PRO by ZoomCharts: The All-in-One Scatter Visual The latest ZoomCharts visual, Drill Down Scatter PRO, is now available on AppSource ! Just like all ZoomCharts visuals, Scatter PRO combines powerful data visualization features with an intuitive and user-friendly user experience. It is designed for fully interactive Power BI…
The OneLake catalog is now part of the Power BI Desktop experience, providing a consistent and seamless way to discover and explore data. This update ensures alignment with the broader Fabric ecosystem, offering users a unified and familiar experience across tools. Microsoft_Fabric_January_2025_update AI-generated content may be incorrect.">
Mirroring now supports replicating source schemas Mirroring in Fabric now supports replicating source schemas. When data is mirrored from various types of sources, your source schema hierarchy is preserved in the mirrored database. This ensures that your data remains consistently organized across different services, allowing you to consume it…
Simplify data ingestion with Copy Job: more connectors and better usability Copy Job simplifies data ingestion, providing a seamless experience from any source to any destination. Whether you need batch or incremental copying, Copy Job provides the flexibility to meet your data needs while keeping things simple and intuitive. Since the Public…
CI/CD support for Dataflows in Fabric We are delighted to share that CI/CD and GIT integration support for Dataflow Gen2 is now available in preview! You can opt into enabling these capabilities when creating a new Dataflow Gen2. New_Dataflow_Gen2_item_experience_with_the_option_to_enable_Git_integration_depl With this new set of features, you…
As part of our commitment to providing a developer-friendly experience that enhances team collaboration, Fabric Git integration will begin exporting semantic model definitions as Tabular Model Definition Language (TMDL) in January 2025. This change will replace the use of a single JSON file (model.bim) with Tabular Model Scripting Language (TMSL).…
Client applications, such as Excel or Power BI Desktop, connecting to Power BI semantic models now benefit from better performance due to an automatic conversion of legacy connection strings (e.g. pbiazure://*) to the XMLA endpoint . Requests are routed directly through the XMLA endpoint, reducing intermediary steps, speeding up request…
We’re excited to announce the release of Copilot in Power BI mobile apps (Preview)! This new feature brings the power of AI directly to your fingertips, enhancing your mobile experience when you’re on the go, offering a quick and simple way to dive into your data. With Copilot in Power BI mobile apps, you no longer need to analyze data yourself.…
Do you need to extract insights from Power BI report images in your email or quickly digest a summary of your Power BI report? Subscribe to Copilot summaries for Power BI reports. This feature is available with Standard subscriptions and for reports in a copilot-eligible capacity . Learn more about using Copilot in Power BI and Fabric . Set up the…
This month we’re introducing a new feature to the Azure Map visual that takes geospatial analytics to the next level -- the Path layer. The Path layer provides users with the ability to visualize geographic connections between multiple points. Whether you’re managing logistics, analyzing network traffic, or tracking asset shipment across the…
The work on visual calculations continues as usual and this month we are adding a highly requested item: support for exporting! You can now export data from visuals that contain one or more visual calculations or hidden fields. If you export data, hidden fields on a visual are not included in the export, unless you export the underlying data . The…
Back in December we announced the preview of alerting capabilities within Power BI reports using Real-Time Intelligence Activator, part of Microsoft Fabric. We are excited to announce that this capability is now generally available! With GA, you’ll be able to: Stay on top of your critical metrics by monitoring your business objects. You can track…
With this month’s update, we’re enhancing the Card visual with a new version that retains all familiar features and updates, while adding advanced functionality and an improved user experience with small multiples. This new feature is currently in preview with the new Card visual, offering an excellent opportunity to experience the capabilities of…
Introducing the new text slicer, now available in our core visuals gallery. This month brings the arrival of the new text slicer in Power BI offering new possibilities for both users and the organization. Enable the new text slicer by navigating to Options and settings > Options > Preview features > text slicer visual to ensure its selected, and…
Creating measures in DAX query view just became even easier. The quick queries option available from the context menu of tables, columns, or other items in the Data pane, now includes Define new measure . Fabric_November_2024_Feature_Summary Description automatically generated"> This will create a new query table with the syntax started for you to…
The preview of metric sets is now officially available for both service and desktop. This is a transformative new feature designed to redefine how organizations manage and consume metrics. Fabric_November_2024_Feature_Summary Description automatically generated"> The Fabric Metric Layer’s home base is the Metrics Hub in Power BI and brings…
We’re excited to announce significant performance improvements for MDX queries on models with Calculation Groups and Format Strings! The latest changes should greatly improve the performance and reliability of operations in Analyze in Excel on models that include one or both of: Dynamic Format Strings for Measures. Calculated Items with Format…
Purview data loss prevention policies for Fabric now enable admins to restrict access based on the sensitive information detected within their semantic models’ data. When Purview compliance admins configure DLP policies for Fabric, they now have the option to decide if upon detecting sensitive information they would like to block access to the…
Power BI developers, the new TMDL Extension for Visual Studio Code in public preview enhances your TMDL editing experience, boosting semantic model development. Fabric_November_2024_Feature_Summary Description automatically generated"> The Tabular Model Definition Language (TMDL) is designed to make model representations readable, editable,…
Case Insensitive collation (Latin1_General_100_CI_AS_KS_WS_SC_UTF8) is now supported in Fabric Warehouse, configurable at warehouse creation via REST API. Default remains case-sensitive Latin1_General_100_BIN2_UTF8. COLLATE T-SQL clause support is coming soon to allow per-column collation in CREATE/ALTER TABLE.
The distributed query processing engine (DQP) task scheduling algorithm has been optimized to reduce contention under moderate to heavy concurrency, delivering significant query performance gains for workspaces running complex queries with multiple concurrent users.
Fabric Warehouse tables can now define VARCHAR(MAX) and VARBINARY(MAX) columns storing up to 1MB per cell, enabling free text and JSON without truncation. Performance improvements ship for string filters, LIKE searches, and GROUP BY / ORDER BY / JOIN operations involving large values.
Warehouse and SQL endpoints for Lakehouse and mirrored databases gain FOR JSON to format query output as JSON, new JSON_OBJECT, JSON_ARRAY, and JSON_PATH_EXISTS functions, and OPENJSON support with CROSS APPLY / OUTER APPLY — aligning Fabric JSON capabilities with SQL Server and Azure SQL.
Fabric API for GraphQL now supports Service Principal authentication, letting applications and microservices call GraphQL endpoints without user credentials. Enables zero-trust patterns, least-privilege access, and auditable application-to-API authentication via Entra App Registration.
The API Explorer can now auto-generate Python and Node.js client code from any tested GraphQL query, giving developers ready-to-use boilerplate to call the API locally and shortening the path from query design to integration.
Notebook Git integration and deployment pipelines are now generally available. Git sync preserves the attached Environment mapping across workspaces, and deployment pipelines auto-bind default lakehouse and environment to the equivalent items in the target stage.
Notebooks can now be embedded in OrgApp as rich content carriers, with cells, visuals, tables, charts, and widgets surfaced alongside dashboards — making notebooks a practical storytelling artifact for end users inside organizational apps.
A public onboarding tour walks new users through core Notebook features, step-by-step interface guidance, and a What's New section accessible from the View tab to highlight recently added capabilities.
Notebooks now expose Develop, Edit, Run Only, and View modes. Recipients automatically see the best mode available for their permissions and can switch between the modes they have access to, simplifying collaboration and access control.
The rich dataframe preview in notebooks now supports multi-column selection, row selection with counts, cell content preview, column summaries with distribution and statistics, and free-area selection with totals over selected numeric cells.
Lakehouse Explorer and main view now support sorting (by name or created date), filtering (by type, loading status, created date), and searching (by name) across schemas, tables, files, and folders for both schema-enabled and no-schema Lakehouses.
Real-Time Dashboards now support Fabric Git integration, providing version control, backup, branch-based collaboration, and the ability to revert to previous states — preventing accidental edits and overwrites in collaborative dashboard work.
KQL Queryset now lets you graphically visualize query results and change visualization formatting instantly through a familiar UI, without re-running the underlying query each time you want a different chart or format.
Results from any KQL Queryset query can now be saved directly to a new or existing Real-Time Dashboard, making it faster to persist findings and share visualizations with the team without rebuilding the query in the dashboard.
We’d like to share an update for the Fabric network security features that were announced in general availability earlier this year. Trusted workspace access, and Managed Private endpoints enable you to secure and optimize your data access and connectivity with Fabric and protect
Fabric now supports Entra Id Multitenant Organizations (MTO). Many larger organizations have multiple Entra Id tenants for various reasons such as mergers and acquisitions, compliance and security boundaries, or due to complex organizational structure. The multitenant organizatio
Fabric Git integration is now generally available! This feature allows you to sync workspaces with Git repositories, leverage version control, and collaborate seamlessly using Azure DevOps or GitHub. Though some items are still in preview, additional items will become generally a
Deployment Pipeline Redesign is now in preview! We are thrilled to announce the launch of Deployment pipelines redesign. This major update brings many improvements and new features designed to make your deployment process more efficient and user-friendly. We’ve reimagined the dep
We are excited to share the latest enhancements to our homepage that are designed to streamline your experience and boost your productivity.
You can now access Databricks Unity Catalog tables directly from Fabric. In Fabric, you can now create a new data item called “Mirrored Azure Databricks Catalog”.
GCS shortcuts and S3 Compatible shortcuts are now generally available. Utilize shortcuts in OneLake to quickly and easily make data accessible in Fabric. No need to set up pipelines or copy jobs, just create a shortcut and your data is immediately available in Fabric.
We recently made big improvements to the REST APIs for OneLake shortcuts, including adding support for all current shortcut types and introducing a new List operation. With these improvements, you can programmatically create and manage your OneLake shortcuts. We’re excited to ann
Support for short-lived, user-delegated OneLake SAS is now in public preview. This functionality allows applications to request a User Delegation Key backed by an Entra ID, and then use this key to construct a OneLake SAS token. This token can be handed off to provide delegated a
Copilot for Data Warehouse in public preview! Copilot for Data Warehouse is an AI assistant that helps developers generate insights through T-SQL exploratory analysis. Copilot is contextualized to your warehouse’s schema. With this feature, data engineers and data analysts can us
SQL analytics endpoint now supports Delta tables with column mapping enabled for public preview. Column mapping is a feature of Delta tables that allows users to include spaces, as well as any of these characters, in the table’s column names: ,;{}()\\n\\t=. The extra characters i
We are enabling the SQL analytics endpoint on schema enabled lakehouses. This allows delta tables in schemas to be queried in the SQL analytics endpoint.
We are excited to share key improvements to our new editor in Fabric Data Warehouse and SQL analytics endpoint to improve the consistency and efficiency of SQL developers' experiences!
We are excited to announce the opening of a Private Preview for a new Migration Experience. Designed to accelerate the migration of SQL Server, Synapse dedicated SQL pools, and other warehouses to the Fabric Data Warehouse, users will be able to migrate the code and data from the
You can now use Fabric Notebooks to develop your Fabric warehouse and consume data from your warehouse or SQL analytics endpoint. The ability to create a new notebook item from the warehouse editor lets you carry over your warehouse context into the notebook and use rich capabili
Fabric Warehouse customers now can use Nested Common Table Expression (NCTE) to deconstruct ordinarily complex queries into smaller reusable blocks. NCTE simplifies complex query code, improves query readability, and query code investigation. With this addition, Fabric Warehouse
We are excited to announce the public preview of High Concurrency mode for Notebooks in Pipeline. This new feature in Microsoft Fabric enables users to share Spark sessions across multiple notebooks within a pipeline.
We're pleased to introduce a new workspace-level setting that allows you to reserve maximum cores for your active jobs for Spark workloads. By default, optimistic job admission is enabled in all workspaces, and it allows jobs to start with their minimum node configuration and sca
We're pleased to introduce a new session expiry control in Data Engineering/Science workspace settings. This feature empowers administrators to set the maximum expiration time limit for notebook interactive sessions. Notebooks are a popular choice for interactive querying, and by
Recently, we launched Fabric Spark connector for Fabric Data Warehouse (DW) in Fabric Runtime to empower Spark developers or data scientists to access and work on data from Fabric DW and SQL analytics endpoint of the lakehouse (either from within the same workspace or from across
T-SQL notebook is now available for public preview. This enhancement broadens our language support, extending from a Spark-centric approach to including T-SQL as well. With this update, T-SQL developers can now utilize Notebook for crafting their T-SQL queries to develop a wareho
Fabric Apache Spark Diagnostic Emitter is now in public preview, a powerful new feature that allows Apache Spark users to collect logs, event logs, and metrics from their Spark applications and send them to various destinations, including Azure Event Hubs, Azure Storage, and Azur
Microsoft Fabric environments is a consolidated item for all your hardware and software settings. In an environment, you can select different Spark runtimes, configure your compute resources, install libraries from public repositories or local directories and more.
Vscode.dev is a lightweight version of VS Code running fully in the browser. We released the extension Synapse VS Code -Remote last year to enable the edit and run Fabric Notebook within vscode.dev. We are excited to announce the introduction of the debug feature for Notebook tod
Introducing support for Python functions in Fabric User Data Functions. Private preview users can now create and run functions that will run on Python version 3.11. This enables users to leverage powerful Python libraries such as pandas, numpy, seaborn and more. These functions a
You can now invoke User Defined Functions (UDFs) in your PySpark code directly from Microsoft Fabric Notebooks or Spark jobs. This integration makes it easy to call reusable functions across different workspaces, reducing the need to rewrite or refactor code.
Functions Hub provides a single location to view, access and manage your User Data Functions. Users can access this feature in the left navigation bar, or in the Data Engineering experience.
We are pleased to announce the support for spaces in Lakehouse Delta table names, enhancing usability for all users across Fabric. This feature allows you to create and query Delta tables with spaces in their names, such as "Sales by Region" or "Customer Feedback". This aligns wi
We are extremely excited to announce the advancement of Fabric Runtime 1.3 from Public Preview to General Availability. Our Apache Spark-based big data execution engine, optimized for both data engineering and data science workflows, has been fully updated and seamlessly integrat
Native Execution Engine for Fabric Runtime 1.3 is now available in public preview. Previously, the Native Execution Engine supported earlier versions of Runtime 1.3, but it is now fully compatible with the latest GA runtime version, which is also based on Delta Lake 3.2.
No code changes are required to speed up the execution of your Apache Spark jobs when using the Native Execution Engine.
We are committed to ensuring that our Microsoft Fabric Spark runtimes remain at the forefront of performance and security. In our ongoing efforts, we occasionally introduce updates that may affect your experience. While we understand the critical nature of these updates, we recog
The Enable/Disable feature for queries and mutations in Microsoft Fabric's GraphQL API provides administrators and developers with granular control over API access and usage. This functionality allows you to selectively activate or deactivate specific queries and mutations within
The Fabric Livy endpoint lets users submit and execute their Spark code on the Spark compute within a designated Fabric workspace, eliminating the need to create any Notebook or Spark Job Definition artifacts. This integration with a specific Lakehouse artifact ensures straightfo
The highly anticipated feature for Fabric AI Skill, the "Share" capability is now in public preview. This powerful addition allows you to share the AI Skill with others using a variety of permission models, providing you with complete control over how your AI Skill is accessed an
Data Wrangler, a notebook-based tool for exploratory data analysis, now works for both pandas DataFrames and Spark DataFrames in general availability. You can use the tool to explore and transform data in your notebook with an immersive visual interface, generating either Python
You may have noticed that Data Wrangler has a new entry point under the “Home” tab of the Fabric notebook ribbon. We’re excited to share additional usability updates designed to improve your experience.
We are excited to share the launch of the **file editor feature** in Fabric Notebook. This new feature allows users to view and edit files directly within the notebook's resource folder and environment resource folder in notebook. Supported file types include CSV, TXT, HTML, YML,
From the list of tables in Real-Time hub, users can click on the three dots menu and select create real-time dashboard. Copilot will review the table and automatically create a dashboard with two pages, one with insights about the data in the table and one page that contains a pr
Real-time dashboards can be included in the new version of org app. The org app can include PBI reports, PBI paginated reports, Notebooks and Real time dashboards. This makes it very easy to distribute RTD to large user cohorts outside a specific Workspace.
We are thrilled to announce the launch of the new Real-Time Hub user experience (UX), a redesigned and enhanced experience that will help you get the most out of your real-time data. Whether you want to monitor, process, analyze, or act on your data streams, the new UX will make
We’re excited to announce the expansion of our Eventstream Connectors with four powerful new streaming sources, enabling even more seamless data streaming across your ecosystem:
As part of our ongoing efforts to enhance Eventstream’s capabilities, we are excited to introduce Eventhouse as a new destination for your data streams. Eventhouses, equipped with KQL Databases, are designed to handle and analyze large volumes of data, particularly in scenarios t
We’re excited to introduce the Private Network feature for Fabric Eventstream! With Fabric’s Managed Private Endpoint, you can now establish a private connection between your Azure services, such as Azure Event Hub, and Fabric Eventstream. This integration ensures your data is se
We’re excited to unveil the newly redesigned KQL DB experience in Microsoft Fabric Real Time Intelligence! This update brings a clean, modern interface packed with powerful features to help you work smarter, whether you’re managing several databases, dealing with streaming data,
Now you can set up Data Activator alerts directly on your KQL queries in KQL querysets. Whether you’re tracking real-time metrics or keeping an eye on important logs, this feature makes sure you get notified the moment something important happens.
The "Top Values" feature in our no-code data exploration UI is available for Real-Time Dashboards’ tiles! This new component makes it easier than ever to explore and understand your data without writing a single line of code. Instantly view the top values for each column in your
We are pleased to share an enhancement to our dashboard auto refresh feature, now supporting **continuous** and **10 seconds** refresh rates, in addition to the existing options.
Now you can use the power of Eventhouse, Spark, and OneLake to perform real-time monitoring and multivariate anomaly detection of time series data. We added a workflow that is based on the algorithm that is used in the AI Anomaly Detector service (which is being retired as a stan
We'd like to share an upgrade to our Copilot assistant, which translates natural language into KQL. Now, the assistant supports a conversational mode, allowing you to ask follow-up questions that build on previous queries within the chat. This enhancement enables a more intuitive
We’re excited to announce the launch of a new rule creation experience within Data Activator. This innovative experience unlocks new capabilities to monitor your events with more fine-tuned controls at greater scale, ensuring you solve and stay on top of your operational business
We’ve streamlined the process of creating Data Activator alerts for your teammates in Power BI. Previously, you had to create your alert in Power BI, then open it in Data Activator to add your teammates as recipients. Now, you can add recipients directly within Power BI. We’re ro
Since folders were introduced in workspaces, it can be hard to find items sometimes because they are all hidden in the hierarchy. We have upgraded the filter experience to support filtering through the entire workspace or through a specific folder with all its nested folders.
OneLake data access roles allow for granular security to be defined within a lakehouse. This month, we’ve updated data access roles based on key feedback.
V-Order is a write-time optimization for the Parquet file format, enabling Direct Lake mode with Power BI. It applies special sorting and compression to Parquet files, offering query benefits but potentially increasing data ingestion time in Fabric Warehouse.
Fabric Warehouse publishes Delta Lake Logs for every table created in your Warehouses. Any modifications made to a Warehouse table will be reflected in the Delta Lake Log within a minute of the transaction being committed. This enables other analytical engines in Microsoft Fabric
Alter Table add Nullable Columns is now generally available! This feature allows for adding new nullable columns to previously created Delta Parquet-backed tables in a warehouse in Microsoft Fabric. In the ever-evolving data landscape of data organizations, schemas are shifting a
Truncate Table in Fabric Datawarehouse, enhancing data management capabilities for the users is now generally available.
We’ve heard your requests and we're excited to extend our capabilities with support for mirrored tables within additional SQL’s Dynamic Definition Language (DDL). Now, operations such as Drop Table, Rename Table, and Rename Column can be seamlessly executed while tables are in th
You can use a more intuitive experience with Modern Get Data to connect data source for Mirroring. On the homepage of Data Warehouse experience, click any Mirroring module to get started.
Beginning in August, the library MsSparkUtils will be rebranded as NotebookUtils. This change reflects our commitment to providing the best tools and utilities for your data processing needs.
The Import Notebook feature has recently been enhanced making it more accessible and intuitive. With this update, you can effortlessly import notebooks, reports, or paginated reports using the unified entry in the workspace toolbar. This improvement streamlines the process, ensur
We recently released the Lifecycle of Apache Spark runtimes in Fabric. Our team diligently delivers new versions, ensuring they are of high quality, well-integrated, and supported continuously. Each version includes about 110 components, and as the runtime grows, we make sure it
Recently, Michael Kovalsky released a python library called ‘ fabric\_cat\_tools‘ for Fabric notebooks. This library includes 120+ additional functions which extend semantic-link’s capabilities ranging from automating the migration of semantic models to Direct Lake, analyzing sem
We have released a new feature that allows users to apply MLflow tags directly on their ML experiment runs and ML model versions from the user interface. This enhancement empowers users to add annotations, track changes, and incorporate additional metadata seamlessly. Whether you
We have a new feature for you that is designed to help users track related ML experiment runs within their Spark applications. This feature allows users to monitor the progress of their Spark applications, which can create one or multiple experiments and related experiment runs.
Integrate Experiment items into the Monitoring Hub with this new feature! With this enhancement, users can track experiment runs directly from the Monitoring Hub, providing a unified view of all their activities. This integration includes powerful filtering options, enabling user
We're releasing an update to code-first AutoML in Fabric. With this update, we now automatically log the input and output schema for non-Spark models trained using AutoML. This enhancement allows users to seamlessly move from training with AutoML to making predictions by leveragi
You can now build your own **generative AI experiences** over your data in Fabric with the Public Preview of the **AI skill**! With this new capability, you can build question and answering AI systems over your Lakehouses and Warehouses. You can configure the AI to respond to que
The Fabric Real-Time Hub now introduces **'teaching bubbles'** that provide a step-by-step guide through its major functionalities. These interactive guides allow you to seamlessly navigate each tab of the Real-Time Hub, offering a clear understanding of the value and core functi
KQL Queryset is a data analysis tool that enables users to write and execute KQL queries against large datasets. It allows for advanced data exploration, manipulation, and visualization, making it easier to derive insights from structured and semi-structured data.
Below are the new and updated connectors in this release:
We are excited to announce the release of two powerful new connectors in Fabric Data Factory data pipeline:
The introduction of **TLS 1.3 support** in the **Data Warehouse connector** marks a significant improvement in data security for data integration processes. TLS 1.3, the latest version of the Transport Layer Security protocol, provides improved encryption, reduced latency, and en
You can easily browse and connect to your Azure resources automatically with the modern data experience of Data Pipeline. With the Browse Azure experience, you can quickly connect to Azure resources without manual filling in some information, such as endpoint, URL, etc.
To reduce complexity and drive more clarity we merged the two options to export to PowerPoint into a single dialog. You can now choose between embedding live data using Power BI add-in for PowerPoint and exporting the report as images from the same dialog.
Private links for Fabric tenant secures inbound access to Fabric from select virtual networks (VNets) and allow you to block access from the internet. With this feature enabled, you can secure connectivity to Fabric OneLake and experiences like Data Warehouse, Data Engineering, Data Science and Data Factory.
Managed private endpoints provide secure connectivity from Fabric to data sources that are behind a firewall or not accessible from the public internet. They currently enable Fabric Data Engineering items to access data sources securely without exposing them to the public network.
Trusted workspace access allows seamless and secure access to firewall enabled Azure storage accounts. It extends OneLake shortcuts to work with data in protected storage accounts in place, and can be used with Data pipelines and the COPY INTO feature of Fabric warehouses.
Organizations who use GitHub or GitHub Enterprise as their source control tool, can now seamlessly integrate with Fabric by connecting Fabric workspaces to GitHub and backup their work. This integration enjoys the same functionalities that the integration with Azure DevOps offers.
Creating and managing Git branches & connected workspaces with Git integration just got better. The updated source control pane includes Branch Out to a New Workspace and Explore related workspaces, with a redesigned pane that organizes features into streamlined tabs.
We are thrilled to extend the data retention period to 30 calendar days from 7 calendar days and announce the General availability of Time travel at the T-SQL Statement level, enabling exploration via Time travel at T-SQL statement level, Time travel with table clone, and restore in place.
Perform restore-in-place of a warehouse in Microsoft Fabric through the Fabric Warehouse Editor. System restore points are created at least every 8 hours, and you can create user-defined restore points aligned with your recovery strategy, all retained for 30 calendar days.
General Availability of Alter Table – Add Nullable columns. Whether your schema modifications are few and far between, or a regular occurrence, this ensures the TSQL surface area meets the needs of customers for a seamless warehousing experience.
Public preview of Capacity Pools, designed specifically for Fabric Data Engineering and Data Science workloads. Capacity administrators can create custom pools using the capacity spark settings option, sized based on the Max Burst Cores limit for Spark for the Fabric Capacity SKU.
The new Environment Resources Folder is a shared repository designed to streamline collaboration across multiple notebooks. Resource files can be shared across multiple notebooks once attached to the current environment, with the path automatically mounted to the notebook cluster.
mssparkutils.runtime.context is available to all now. With the new API you can get the context information of the current live session, including the notebook name, default lakehouse, workspace info, and whether it's a pipeline run.
Lakehouse schemas allow you to group and manage your tables in logical namespaces. Organize tables by categories, use schema shortcuts, apply security policies for granular access control, and cross-reference and join tables from different workspaces using Spark SQL.
Real-time Dashboards now support ultra-low refresh rates of just 1 and 10 seconds, ensuring you always have the freshest data at your fingertips. With auto-refresh, your dashboards update automatically, eliminating the need to manually reload or click a refresh button.
The .update command, which allows you to update records by deleting existing records and appending new ones in a single transaction in Eventhouse and KQL databases, is now Generally Available.
Manage connections lets you see and edit all the connections in your Dataflow and data sources without a linked connection. A new Global view shows all available connections in your Fabric environment so you can modify or delete them without leaving the Dataflow experience.
A new experience to edit navigation steps within Dataflow, found inside the Applied steps section of the Query settings pane. Unlike Power Query Desktop, editing only modifies the Navigation steps and does not delete subsequent steps.
Boost performance with Fast Copy in Dataflow Gen2 when loading data from on-premises data stores including SQL Server. Configure the Gateway the same way as for Dataflow Gen2 to ingest terabytes of data with the easy dataflow experience and the scalable backend of pipeline Copy Activity.
New and updated connectors in this release including Windsor, BuildingConnected, OneStream (new) and SingleStore, Smartsheet, Exact Online Premium, Funnel, Wolters Kluwer CCH Tagetik, and Delta Sharing (updated).
You can now edit the JSON behind your Data Factory pipelines in Fabric. Directly editing the JSON code behind your visual pipeline canvas can increase flexibility and improve your time to market, fulfilling a long-standing request from ADF and Synapse developers.
Two new connectors in Fabric Data Factory data pipeline: Azure MySQL Database Connector and Azure Cosmos DB for MongoDB Connector, enabling seamless, secure, and efficient integration with MySQL on Azure and high-compatibility NoSQL access to Azure Cosmos DB for MongoDB.
The Fabric Data Factory Snowflake Connector now supports Snowflake storage integration, allowing you to streamline data workflows and optimize performance across all staging scenarios without needing external storage to stage your dataset, with richer authentication methods.
OneLake Datahub at the homepage of Modern Get Data in Data Pipeline now lets you select any existing connection, not just your recent and favorite ones, making it easier to access your data sources.
