Skip to content

Commit 81b3a58

Browse files
authored
Add PolyBase data virtualization guide and update existing overview (#36598)
1 parent 03d4939 commit 81b3a58

55 files changed

Lines changed: 879 additions & 74 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

.openpublishing.redirection.json

Lines changed: 12 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -50337,7 +50337,7 @@
5033750337
},
5033850338
{
5033950339
"source_path": "docs/relational-databases/polybase/get-started-with-polybase.md",
50340-
"redirect_url": "/sql/relational-databases/polybase/polybase-guide",
50340+
"redirect_url": "/sql/relational-databases/polybase/overview",
5034150341
"redirect_document_id": false
5034250342
},
5034350343
{
@@ -66372,7 +66372,7 @@
6637266372
},
6637366373
{
6637466374
"source_path": "docs/relational-databases/polybase/index.md",
66375-
"redirect_url": "/sql/relational-databases/polybase/polybase-guide",
66375+
"redirect_url": "/sql/relational-databases/polybase/overview",
6637666376
"redirect_document_id": false
6637766377
},
6637866378
{
@@ -68233,6 +68233,16 @@
6823368233
"source_path": "docs/azdata/reference/reference-azdata.md",
6823468234
"redirect_url": "/previous-versions/sql/big-data-cluster/reference-azdata",
6823568235
"redirect_document_id": false
68236+
},
68237+
{
68238+
"source_path": "docs/relational-databases/polybase/polybase-guide.md",
68239+
"redirect_url": "/sql/relational-databases/polybase/overview",
68240+
"redirect_document_id": false
68241+
},
68242+
{
68243+
"source_path": "docs/relational-databases/polybase/data-virtualization-comprehensive-guide.md",
68244+
"redirect_url": "/sql/relational-databases/polybase/data-virtualization-guide",
68245+
"redirect_document_id": false
6823668246
}
6823768247
]
6823868248
}

docs/analytics-platform-system/configure-polybase-connectivity-to-external-data.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -15,7 +15,7 @@ PolyBase enables your Analytics Platform System (APS) to process Transact-SQL qu
1515

1616
![PolyBase logical](media/polybase/polybase-logical.png)
1717

18-
PolyBase on APS supports reading and writing to Hadoop (HDFS) file system and Azure Blob Storage. PolyBase also has the ability to push some computation to Hadoop nodes as mapreduce jobs to optimize the overall query performance. PolyBase on APS can operate on delimited text, ORC and Parquet files. See [What is PolyBase](../relational-databases/polybase/polybase-guide.md) for a full description and its capabilities.
18+
PolyBase on APS supports reading and writing to Hadoop (HDFS) file system and Azure Blob Storage. PolyBase also has the ability to push some computation to Hadoop nodes as mapreduce jobs to optimize the overall query performance. PolyBase on APS can operate on delimited text, ORC and Parquet files. See [What is PolyBase](../relational-databases/polybase/overview.md) for a full description and its capabilities.
1919

2020
> [!NOTE]
2121
> APS currently only supports standard general purpose v1 locally redundant (LRS) Azure Blob Storage.

docs/analytics-platform-system/polybase-configure-azure-blob-storage.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -173,4 +173,4 @@ In SQL Server Data Tools (SSDT), external tables are displayed in a separate fol
173173
## Next step
174174

175175
> [!div class="nextstepaction"]
176-
> [Introducing data virtualization with PolyBase](../relational-databases/polybase/polybase-guide.md)
176+
> [Introducing data virtualization with PolyBase](../relational-databases/polybase/overview.md)

docs/analytics-platform-system/polybase-configure-hadoop.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -332,4 +332,4 @@ In SQL Server Data Tools, external tables are displayed in a separate folder **E
332332
## Related content
333333

334334
- For Hadoop security settings see [configure Hadoop security](polybase-configure-hadoop-security.md).
335-
- For more information about PolyBase, see the [What is PolyBase?](../relational-databases/polybase/polybase-guide.md).
335+
- For more information about PolyBase, see the [What is PolyBase?](../relational-databases/polybase/overview.md).

docs/database-engine/configure-windows/allow-polybase-export.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -18,7 +18,7 @@ The `allow polybase export` server configuration option allows the export of dat
1818

1919
- In [!INCLUDE [sssql22-md](../../includes/sssql22-md.md)] and later versions, the [CREATE EXTERNAL TABLE AS SELECT](../../t-sql/statements/create-external-table-as-select-transact-sql.md) (CETAS) statement requires that you enable `allow polybase export` using `sp_configure`. This setting allows for data to be exported to a CSV or Parquet file. For examples, see [Use CREATE EXTERNAL TABLE AS SELECT exporting data as parquet](../../t-sql/statements/create-external-table-as-select-transact-sql.md#d-use-create-external-table-as-select-exporting-data-as-parquet).
2020

21-
- In [!INCLUDE [sssql19-md](../../includes/sssql19-md.md)] and earlier versions, enabling `allow polybase export` allows Hadoop to export data out of [!INCLUDE [ssnoversion-md](../../includes/ssnoversion-md.md)] to an external table. For more information, see [PolyBase connectors](../../relational-databases/polybase/polybase-guide.md#polybase-connectors) and [Export data](../../relational-databases/polybase/polybase-queries.md#export-data).
21+
- In [!INCLUDE [sssql19-md](../../includes/sssql19-md.md)] and earlier versions, enabling `allow polybase export` allows Hadoop to export data out of [!INCLUDE [ssnoversion-md](../../includes/ssnoversion-md.md)] to an external table. For more information, see [PolyBase connectors](../../relational-databases/polybase/overview.md#polybase-connectors) and [Export data](../../relational-databases/polybase/polybase-queries.md#export-data).
2222

2323
The possible values are described in the following table:
2424

@@ -50,5 +50,5 @@ GO
5050
## Related content
5151

5252
- [Exporting data](../../relational-databases/polybase/polybase-configure-hadoop.md#exporting-data)
53-
- [Data virtualization with PolyBase in SQL Server](../../relational-databases/polybase/polybase-guide.md)
53+
- [Data virtualization with PolyBase in SQL Server](../../relational-databases/polybase/overview.md)
5454
- [CREATE EXTERNAL TABLE AS SELECT (CETAS) (Transact-SQL)](../../t-sql/statements/create-external-table-as-select-transact-sql.md)

docs/database-engine/configure-windows/polybase-connectivity-configuration-transact-sql.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -167,7 +167,7 @@ GO
167167

168168
## Related content
169169

170-
- [Data virtualization with PolyBase in SQL Server](../../relational-databases/polybase/polybase-guide.md)
170+
- [Data virtualization with PolyBase in SQL Server](../../relational-databases/polybase/overview.md)
171171
- [sp_configure (Transact-SQL)](../../relational-databases/system-stored-procedures/sp-configure-transact-sql.md)
172172
- [CREATE EXTERNAL TABLE (Transact-SQL)](../../t-sql/statements/create-external-table-transact-sql.md)
173173
- [CREATE EXTERNAL FILE FORMAT (Transact-SQL)](../../t-sql/statements/create-external-file-format-transact-sql.md)

docs/database-engine/configure-windows/polybase-network-encryption-server-configuration-option.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -81,6 +81,6 @@ Requires `ALTER SETTINGS` server-level permission or membership in the **sysadmi
8181
## Related content
8282

8383
- [Exporting data](../../relational-databases/polybase/polybase-configure-hadoop.md#exporting-data)
84-
- [Data virtualization with PolyBase in SQL Server](../../relational-databases/polybase/polybase-guide.md)
84+
- [Data virtualization with PolyBase in SQL Server](../../relational-databases/polybase/overview.md)
8585
- [CREATE EXTERNAL TABLE AS SELECT (CETAS) (Transact-SQL)](../../t-sql/statements/create-external-table-as-select-transact-sql.md)
8686
- [PolyBase errors and possible solutions](../../relational-databases/polybase/polybase-errors-and-possible-solutions.md)

docs/database-engine/install-windows/install-sql-server-database-engine.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -56,7 +56,7 @@ The following features are installed when you select **SQL Server Database Engin
5656
> [!NOTE]
5757
> In this release, selecting the **Data Quality Services** check box in setup doesn't install the Data Quality Services (DQS) server. You'll have to perform additional steps post installation to install DQS server. For more information, see [Install Data Quality Services](../../data-quality-services/install-windows/install-data-quality-services.md).
5858
59-
- [Data virtualization with PolyBase in SQL Server](../../relational-databases/polybase/polybase-guide.md) is an optional component. In [!INCLUDE [sssql19-md](../../includes/sssql19-md.md)], a Java connector for HDFS data sources is also available.
59+
- [Data virtualization with PolyBase in SQL Server](../../relational-databases/polybase/overview.md) is an optional component. In [!INCLUDE [sssql19-md](../../includes/sssql19-md.md)], a Java connector for HDFS data sources is also available.
6060

6161
The following additional features are options for many typical user scenarios:
6262

docs/relational-databases/linked-servers/linked-servers-openquery-openrowset-exec-at.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -39,7 +39,7 @@ Executes the specified pass-through query on the specified linked server. This s
3939

4040
[OPENROWSET (Transact-SQL)](../../t-sql/functions/openrowset-transact-sql.md)
4141

42-
Includes all connection information that is required to access remote data from an OLE DB data source. This method is an alternative to accessing tables in a linked server and is a one-time, ad hoc method of connecting and accessing remote data by using OLE DB. For more frequent references to OLE DB data sources, instead consider using [linked servers](linked-servers-database-engine.md), [PolyBase](../polybase/polybase-guide.md), or direct connections between the two data sources via tools like [SQL Server Integration Services (SSIS)](../../integration-services/sql-server-integration-services.md) or custom applications.
42+
Includes all connection information that is required to access remote data from an OLE DB data source. This method is an alternative to accessing tables in a linked server and is a one-time, ad hoc method of connecting and accessing remote data by using OLE DB. For more frequent references to OLE DB data sources, instead consider using [linked servers](linked-servers-database-engine.md), [PolyBase](../polybase/overview.md), or direct connections between the two data sources via tools like [SQL Server Integration Services (SSIS)](../../integration-services/sql-server-integration-services.md) or custom applications.
4343

4444
In a query, use `OPENROWSET` in the `FROM` clause of a query. You can also use `OPENROWSET` as the target table of an `INSERT`, `UPDATE`, or `DELETE` statement, subject to the capabilities of the OLE DB provider. Although the query might return multiple result sets, `OPENROWSET` returns only the first one.
4545

docs/relational-databases/polybase/configure-scale-out-groups-windows.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -112,4 +112,4 @@ After setup is complete, both machines can function as PolyBase Group head nodes
112112
## Related content
113113

114114
- [PolyBase troubleshooting with dynamic management views](/previous-versions/sql/sql-server-2016/mt146389(v=sql.130))
115-
- [Introducing data virtualization with PolyBase](polybase-guide.md)
115+
- [Introducing data virtualization with PolyBase](overview.md)

0 commit comments

Comments
 (0)