airbyte.SourceGcs

Coming soon!

Coming soon!

Coming soon!

Coming soon!

name string

The unique name of the resource.

args SourceGcsArgs

The arguments to resource properties.

opts CustomResourceOptions

Bag of options to control resource's behavior.

resource_name str

The unique name of the resource.

args SourceGcsArgs

The arguments to resource properties.

opts ResourceOptions

Bag of options to control resource's behavior.

ctx Context

Context object for the current deployment.

name string

The unique name of the resource.

args SourceGcsArgs

The arguments to resource properties.

opts ResourceOption

Bag of options to control resource's behavior.

name string

The unique name of the resource.

args SourceGcsArgs

The arguments to resource properties.

opts CustomResourceOptions

Bag of options to control resource's behavior.

name String

The unique name of the resource.

args SourceGcsArgs

The arguments to resource properties.

options CustomResourceOptions

Bag of options to control resource's behavior.

Configuration SourceGcsConfiguration

NOTE: When this Spec is changed, legacyconfigtransformer.py must also be modified to uptake the changes because it is responsible for converting legacy GCS configs into file based configs using the File-Based CDK.

WorkspaceId string

DefinitionId string

The UUID of the connector definition. One of configuration.sourceType or definitionId must be provided. Requires replacement if changed.

Name string

Name of the source e.g. dev-mysql-instance.

SecretId string

Optional secretID obtained through the public API OAuth redirect flow. Requires replacement if changed.

Configuration SourceGcsConfigurationArgs

NOTE: When this Spec is changed, legacyconfigtransformer.py must also be modified to uptake the changes because it is responsible for converting legacy GCS configs into file based configs using the File-Based CDK.

WorkspaceId string

DefinitionId string

The UUID of the connector definition. One of configuration.sourceType or definitionId must be provided. Requires replacement if changed.

Name string

Name of the source e.g. dev-mysql-instance.

SecretId string

Optional secretID obtained through the public API OAuth redirect flow. Requires replacement if changed.

configuration SourceGcsConfiguration

NOTE: When this Spec is changed, legacyconfigtransformer.py must also be modified to uptake the changes because it is responsible for converting legacy GCS configs into file based configs using the File-Based CDK.

workspaceId String

definitionId String

The UUID of the connector definition. One of configuration.sourceType or definitionId must be provided. Requires replacement if changed.

name String

Name of the source e.g. dev-mysql-instance.

secretId String

Optional secretID obtained through the public API OAuth redirect flow. Requires replacement if changed.

configuration SourceGcsConfiguration

NOTE: When this Spec is changed, legacyconfigtransformer.py must also be modified to uptake the changes because it is responsible for converting legacy GCS configs into file based configs using the File-Based CDK.

workspaceId string

definitionId string

The UUID of the connector definition. One of configuration.sourceType or definitionId must be provided. Requires replacement if changed.

name string

Name of the source e.g. dev-mysql-instance.

secretId string

Optional secretID obtained through the public API OAuth redirect flow. Requires replacement if changed.

configuration SourceGcsConfigurationArgs

NOTE: When this Spec is changed, legacyconfigtransformer.py must also be modified to uptake the changes because it is responsible for converting legacy GCS configs into file based configs using the File-Based CDK.

workspace_id str

definition_id str

The UUID of the connector definition. One of configuration.sourceType or definitionId must be provided. Requires replacement if changed.

name str

Name of the source e.g. dev-mysql-instance.

secret_id str

Optional secretID obtained through the public API OAuth redirect flow. Requires replacement if changed.

configuration Property Map

NOTE: When this Spec is changed, legacyconfigtransformer.py must also be modified to uptake the changes because it is responsible for converting legacy GCS configs into file based configs using the File-Based CDK.

workspaceId String

definitionId String

The UUID of the connector definition. One of configuration.sourceType or definitionId must be provided. Requires replacement if changed.

name String

Name of the source e.g. dev-mysql-instance.

secretId String

Optional secretID obtained through the public API OAuth redirect flow. Requires replacement if changed.

CreatedAt double

Id string

The provider-assigned unique ID for this managed resource.

ResourceAllocation SourceGcsResourceAllocation

actor or actor definition specific resource requirements. if default is set, these are the requirements that should be set for ALL jobs run for this actor definition. it is overriden by the job type specific configurations. if not set, the platform will use defaults. these values will be overriden by configuration at the connection level.

SourceId string

SourceType string

CreatedAt float64

Id string

The provider-assigned unique ID for this managed resource.

ResourceAllocation SourceGcsResourceAllocation

actor or actor definition specific resource requirements. if default is set, these are the requirements that should be set for ALL jobs run for this actor definition. it is overriden by the job type specific configurations. if not set, the platform will use defaults. these values will be overriden by configuration at the connection level.

SourceId string

SourceType string

createdAt Double

id String

The provider-assigned unique ID for this managed resource.

resourceAllocation SourceGcsResourceAllocation

actor or actor definition specific resource requirements. if default is set, these are the requirements that should be set for ALL jobs run for this actor definition. it is overriden by the job type specific configurations. if not set, the platform will use defaults. these values will be overriden by configuration at the connection level.

sourceId String

sourceType String

createdAt number

id string

The provider-assigned unique ID for this managed resource.

resourceAllocation SourceGcsResourceAllocation

actor or actor definition specific resource requirements. if default is set, these are the requirements that should be set for ALL jobs run for this actor definition. it is overriden by the job type specific configurations. if not set, the platform will use defaults. these values will be overriden by configuration at the connection level.

sourceId string

sourceType string

created_at float

id str

The provider-assigned unique ID for this managed resource.

resource_allocation SourceGcsResourceAllocation

actor or actor definition specific resource requirements. if default is set, these are the requirements that should be set for ALL jobs run for this actor definition. it is overriden by the job type specific configurations. if not set, the platform will use defaults. these values will be overriden by configuration at the connection level.

source_id str

source_type str

createdAt Number

id String

The provider-assigned unique ID for this managed resource.

resourceAllocation Property Map

actor or actor definition specific resource requirements. if default is set, these are the requirements that should be set for ALL jobs run for this actor definition. it is overriden by the job type specific configurations. if not set, the platform will use defaults. these values will be overriden by configuration at the connection level.

sourceId String

sourceType String

name

The unique name of the resulting resource.

id

The unique provider ID of the resource to lookup.

state

Any extra arguments used during the lookup.

opts

A bag of options that control this resource's behavior.

resource_name

The unique name of the resulting resource.

id

The unique provider ID of the resource to lookup.

name

The unique name of the resulting resource.

id

The unique provider ID of the resource to lookup.

state

Any extra arguments used during the lookup.

opts

A bag of options that control this resource's behavior.

name

The unique name of the resulting resource.

id

The unique provider ID of the resource to lookup.

state

Any extra arguments used during the lookup.

opts

A bag of options that control this resource's behavior.

name

The unique name of the resulting resource.

id

The unique provider ID of the resource to lookup.

state

Any extra arguments used during the lookup.

opts

A bag of options that control this resource's behavior.

Bucket string

Name of the GCS bucket where the file(s) exist.

Credentials SourceGcsConfigurationCredentials

Credentials for connecting to the Google Cloud Storage API

Streams List<SourceGcsConfigurationStream>

Each instance of this configuration defines a \n\nstream\n\n. Use this to define which files belong in the stream, their format, and how they should be parsed and validated. When sending data to warehouse destination such as Snowflake or BigQuery, each stream is a separate table.

StartDate string

UTC date and time in the format 2017-01-25T00:00:00.000000Z. Any file modified before this date will not be replicated.

Bucket string

Name of the GCS bucket where the file(s) exist.

Credentials SourceGcsConfigurationCredentials

Credentials for connecting to the Google Cloud Storage API

Streams []SourceGcsConfigurationStream

Each instance of this configuration defines a \n\nstream\n\n. Use this to define which files belong in the stream, their format, and how they should be parsed and validated. When sending data to warehouse destination such as Snowflake or BigQuery, each stream is a separate table.

StartDate string

UTC date and time in the format 2017-01-25T00:00:00.000000Z. Any file modified before this date will not be replicated.

bucket String

Name of the GCS bucket where the file(s) exist.

credentials SourceGcsConfigurationCredentials

Credentials for connecting to the Google Cloud Storage API

streams List<SourceGcsConfigurationStream>

Each instance of this configuration defines a \n\nstream\n\n. Use this to define which files belong in the stream, their format, and how they should be parsed and validated. When sending data to warehouse destination such as Snowflake or BigQuery, each stream is a separate table.

startDate String

UTC date and time in the format 2017-01-25T00:00:00.000000Z. Any file modified before this date will not be replicated.

bucket string

Name of the GCS bucket where the file(s) exist.

credentials SourceGcsConfigurationCredentials

Credentials for connecting to the Google Cloud Storage API

streams SourceGcsConfigurationStream[]

Each instance of this configuration defines a \n\nstream\n\n. Use this to define which files belong in the stream, their format, and how they should be parsed and validated. When sending data to warehouse destination such as Snowflake or BigQuery, each stream is a separate table.

startDate string

UTC date and time in the format 2017-01-25T00:00:00.000000Z. Any file modified before this date will not be replicated.

bucket str

Name of the GCS bucket where the file(s) exist.

credentials SourceGcsConfigurationCredentials

Credentials for connecting to the Google Cloud Storage API

streams Sequence[SourceGcsConfigurationStream]

Each instance of this configuration defines a \n\nstream\n\n. Use this to define which files belong in the stream, their format, and how they should be parsed and validated. When sending data to warehouse destination such as Snowflake or BigQuery, each stream is a separate table.

start_date str

UTC date and time in the format 2017-01-25T00:00:00.000000Z. Any file modified before this date will not be replicated.

bucket String

Name of the GCS bucket where the file(s) exist.

credentials Property Map

Credentials for connecting to the Google Cloud Storage API

streams List<Property Map>

Each instance of this configuration defines a \n\nstream\n\n. Use this to define which files belong in the stream, their format, and how they should be parsed and validated. When sending data to warehouse destination such as Snowflake or BigQuery, each stream is a separate table.

startDate String

UTC date and time in the format 2017-01-25T00:00:00.000000Z. Any file modified before this date will not be replicated.

AuthenticateViaGoogleOAuth SourceGcsConfigurationCredentialsAuthenticateViaGoogleOAuth

ServiceAccountAuthentication SourceGcsConfigurationCredentialsServiceAccountAuthentication

AuthenticateViaGoogleOAuth SourceGcsConfigurationCredentialsAuthenticateViaGoogleOAuth

ServiceAccountAuthentication SourceGcsConfigurationCredentialsServiceAccountAuthentication

authenticateViaGoogleOAuth SourceGcsConfigurationCredentialsAuthenticateViaGoogleOAuth

serviceAccountAuthentication SourceGcsConfigurationCredentialsServiceAccountAuthentication

authenticateViaGoogleOAuth SourceGcsConfigurationCredentialsAuthenticateViaGoogleOAuth

serviceAccountAuthentication SourceGcsConfigurationCredentialsServiceAccountAuthentication

authenticate_via_google_o_auth SourceGcsConfigurationCredentialsAuthenticateViaGoogleOAuth

service_account_authentication SourceGcsConfigurationCredentialsServiceAccountAuthentication

authenticateViaGoogleOAuth Property Map

serviceAccountAuthentication Property Map

AccessToken string

Access Token

ClientId string

Client ID

ClientSecret string

Client Secret

RefreshToken string

Access Token

AccessToken string

Access Token

ClientId string

Client ID

ClientSecret string

Client Secret

RefreshToken string

Access Token

accessToken String

Access Token

clientId String

Client ID

clientSecret String

Client Secret

refreshToken String

Access Token

accessToken string

Access Token

clientId string

Client ID

clientSecret string

Client Secret

refreshToken string

Access Token

access_token str

Access Token

client_id str

Client ID

client_secret str

Client Secret

refresh_token str

Access Token

accessToken String

Access Token

clientId String

Client ID

clientSecret String

Client Secret

refreshToken String

Access Token

ServiceAccount string

Enter your Google Cloud \n\nservice account key\n\n in JSON format

ServiceAccount string

Enter your Google Cloud \n\nservice account key\n\n in JSON format

serviceAccount String

Enter your Google Cloud \n\nservice account key\n\n in JSON format

serviceAccount string

Enter your Google Cloud \n\nservice account key\n\n in JSON format

service_account str

Enter your Google Cloud \n\nservice account key\n\n in JSON format

serviceAccount String

Enter your Google Cloud \n\nservice account key\n\n in JSON format

Format SourceGcsConfigurationStreamFormat

The configuration options that are used to alter how to read incoming files that deviate from the standard formatting.

Name string

The name of the stream.

DaysToSyncIfHistoryIsFull double

When the state history of the file store is full, syncs will only read files that were last modified in the provided day range. Default: 3

Globs List<string>

The pattern used to specify which files should be selected from the file system. For more information on glob pattern matching look \n\nhere\n\n.

InputSchema string

The schema that will be used to validate records extracted from the file. This will override the stream schema that is auto-detected from incoming files.

RecentNFilesToReadForSchemaDiscovery double

The number of resent files which will be used to discover the schema for this stream.

Schemaless bool

When enabled, syncs will not validate or structure records against the stream's schema. Default: false

ValidationPolicy string

The name of the validation policy that dictates sync behavior when a record does not adhere to the stream schema. Default: "Emit Record"; must be one of ["Emit Record", "Skip Record", "Wait for Discover"]

Format SourceGcsConfigurationStreamFormat

The configuration options that are used to alter how to read incoming files that deviate from the standard formatting.

Name string

The name of the stream.

DaysToSyncIfHistoryIsFull float64

When the state history of the file store is full, syncs will only read files that were last modified in the provided day range. Default: 3

Globs []string

The pattern used to specify which files should be selected from the file system. For more information on glob pattern matching look \n\nhere\n\n.

InputSchema string

The schema that will be used to validate records extracted from the file. This will override the stream schema that is auto-detected from incoming files.

RecentNFilesToReadForSchemaDiscovery float64

The number of resent files which will be used to discover the schema for this stream.

Schemaless bool

When enabled, syncs will not validate or structure records against the stream's schema. Default: false

ValidationPolicy string

The name of the validation policy that dictates sync behavior when a record does not adhere to the stream schema. Default: "Emit Record"; must be one of ["Emit Record", "Skip Record", "Wait for Discover"]

format SourceGcsConfigurationStreamFormat

The configuration options that are used to alter how to read incoming files that deviate from the standard formatting.

name String

The name of the stream.

daysToSyncIfHistoryIsFull Double

When the state history of the file store is full, syncs will only read files that were last modified in the provided day range. Default: 3

globs List<String>

The pattern used to specify which files should be selected from the file system. For more information on glob pattern matching look \n\nhere\n\n.

inputSchema String

The schema that will be used to validate records extracted from the file. This will override the stream schema that is auto-detected from incoming files.

recentNFilesToReadForSchemaDiscovery Double

The number of resent files which will be used to discover the schema for this stream.

schemaless Boolean

When enabled, syncs will not validate or structure records against the stream's schema. Default: false

validationPolicy String

The name of the validation policy that dictates sync behavior when a record does not adhere to the stream schema. Default: "Emit Record"; must be one of ["Emit Record", "Skip Record", "Wait for Discover"]

format SourceGcsConfigurationStreamFormat

The configuration options that are used to alter how to read incoming files that deviate from the standard formatting.

name string

The name of the stream.

daysToSyncIfHistoryIsFull number

When the state history of the file store is full, syncs will only read files that were last modified in the provided day range. Default: 3

globs string[]

The pattern used to specify which files should be selected from the file system. For more information on glob pattern matching look \n\nhere\n\n.

inputSchema string

The schema that will be used to validate records extracted from the file. This will override the stream schema that is auto-detected from incoming files.

recentNFilesToReadForSchemaDiscovery number

The number of resent files which will be used to discover the schema for this stream.

schemaless boolean

When enabled, syncs will not validate or structure records against the stream's schema. Default: false

validationPolicy string

The name of the validation policy that dictates sync behavior when a record does not adhere to the stream schema. Default: "Emit Record"; must be one of ["Emit Record", "Skip Record", "Wait for Discover"]

format SourceGcsConfigurationStreamFormat

The configuration options that are used to alter how to read incoming files that deviate from the standard formatting.

name str

The name of the stream.

days_to_sync_if_history_is_full float

When the state history of the file store is full, syncs will only read files that were last modified in the provided day range. Default: 3

globs Sequence[str]

The pattern used to specify which files should be selected from the file system. For more information on glob pattern matching look \n\nhere\n\n.

input_schema str

The schema that will be used to validate records extracted from the file. This will override the stream schema that is auto-detected from incoming files.

recent_n_files_to_read_for_schema_discovery float

The number of resent files which will be used to discover the schema for this stream.

schemaless bool

When enabled, syncs will not validate or structure records against the stream's schema. Default: false

validation_policy str

The name of the validation policy that dictates sync behavior when a record does not adhere to the stream schema. Default: "Emit Record"; must be one of ["Emit Record", "Skip Record", "Wait for Discover"]

format Property Map

The configuration options that are used to alter how to read incoming files that deviate from the standard formatting.

name String

The name of the stream.

daysToSyncIfHistoryIsFull Number

When the state history of the file store is full, syncs will only read files that were last modified in the provided day range. Default: 3

globs List<String>

The pattern used to specify which files should be selected from the file system. For more information on glob pattern matching look \n\nhere\n\n.

inputSchema String

The schema that will be used to validate records extracted from the file. This will override the stream schema that is auto-detected from incoming files.

recentNFilesToReadForSchemaDiscovery Number

The number of resent files which will be used to discover the schema for this stream.

schemaless Boolean

When enabled, syncs will not validate or structure records against the stream's schema. Default: false

validationPolicy String

The name of the validation policy that dictates sync behavior when a record does not adhere to the stream schema. Default: "Emit Record"; must be one of ["Emit Record", "Skip Record", "Wait for Discover"]

AvroFormat SourceGcsConfigurationStreamFormatAvroFormat

CsvFormat SourceGcsConfigurationStreamFormatCsvFormat

ExcelFormat SourceGcsConfigurationStreamFormatExcelFormat

JsonlFormat SourceGcsConfigurationStreamFormatJsonlFormat

ParquetFormat SourceGcsConfigurationStreamFormatParquetFormat

UnstructuredDocumentFormat SourceGcsConfigurationStreamFormatUnstructuredDocumentFormat

Extract text from document formats (.pdf, .docx, .md, .pptx) and emit as one record per file.

AvroFormat SourceGcsConfigurationStreamFormatAvroFormat

CsvFormat SourceGcsConfigurationStreamFormatCsvFormat

ExcelFormat SourceGcsConfigurationStreamFormatExcelFormat

JsonlFormat SourceGcsConfigurationStreamFormatJsonlFormat

ParquetFormat SourceGcsConfigurationStreamFormatParquetFormat

UnstructuredDocumentFormat SourceGcsConfigurationStreamFormatUnstructuredDocumentFormat

Extract text from document formats (.pdf, .docx, .md, .pptx) and emit as one record per file.

avroFormat SourceGcsConfigurationStreamFormatAvroFormat

csvFormat SourceGcsConfigurationStreamFormatCsvFormat

excelFormat SourceGcsConfigurationStreamFormatExcelFormat

jsonlFormat SourceGcsConfigurationStreamFormatJsonlFormat

parquetFormat SourceGcsConfigurationStreamFormatParquetFormat

unstructuredDocumentFormat SourceGcsConfigurationStreamFormatUnstructuredDocumentFormat

Extract text from document formats (.pdf, .docx, .md, .pptx) and emit as one record per file.

avroFormat SourceGcsConfigurationStreamFormatAvroFormat

csvFormat SourceGcsConfigurationStreamFormatCsvFormat

excelFormat SourceGcsConfigurationStreamFormatExcelFormat

jsonlFormat SourceGcsConfigurationStreamFormatJsonlFormat

parquetFormat SourceGcsConfigurationStreamFormatParquetFormat

unstructuredDocumentFormat SourceGcsConfigurationStreamFormatUnstructuredDocumentFormat

Extract text from document formats (.pdf, .docx, .md, .pptx) and emit as one record per file.

avro_format SourceGcsConfigurationStreamFormatAvroFormat

csv_format SourceGcsConfigurationStreamFormatCsvFormat

excel_format SourceGcsConfigurationStreamFormatExcelFormat

jsonl_format SourceGcsConfigurationStreamFormatJsonlFormat

parquet_format SourceGcsConfigurationStreamFormatParquetFormat

unstructured_document_format SourceGcsConfigurationStreamFormatUnstructuredDocumentFormat

Extract text from document formats (.pdf, .docx, .md, .pptx) and emit as one record per file.

avroFormat Property Map

csvFormat Property Map

excelFormat Property Map

jsonlFormat Property Map

parquetFormat Property Map

unstructuredDocumentFormat Property Map

Extract text from document formats (.pdf, .docx, .md, .pptx) and emit as one record per file.

DoubleAsString bool

Whether to convert double fields to strings. This is recommended if you have decimal numbers with a high degree of precision because there can be a loss precision when handling floating point numbers. Default: false

DoubleAsString bool

Whether to convert double fields to strings. This is recommended if you have decimal numbers with a high degree of precision because there can be a loss precision when handling floating point numbers. Default: false

doubleAsString Boolean

Whether to convert double fields to strings. This is recommended if you have decimal numbers with a high degree of precision because there can be a loss precision when handling floating point numbers. Default: false

doubleAsString boolean

Whether to convert double fields to strings. This is recommended if you have decimal numbers with a high degree of precision because there can be a loss precision when handling floating point numbers. Default: false

double_as_string bool

Whether to convert double fields to strings. This is recommended if you have decimal numbers with a high degree of precision because there can be a loss precision when handling floating point numbers. Default: false

doubleAsString Boolean

Whether to convert double fields to strings. This is recommended if you have decimal numbers with a high degree of precision because there can be a loss precision when handling floating point numbers. Default: false

Delimiter string

The character delimiting individual cells in the CSV data. This may only be a 1-character string. For tab-delimited data enter '\t'. Default: ","

DoubleQuote bool

Whether two quotes in a quoted CSV value denote a single quote in the data. Default: true

Encoding string

The character encoding of the CSV data. Leave blank to default to \n\nUTF8\n\n. See \n\nlist of python encodings\n\n for allowable options. Default: "utf8"

EscapeChar string

The character used for escaping special characters. To disallow escaping, leave this field blank.

FalseValues List<string>

A set of case-sensitive strings that should be interpreted as false values.

HeaderDefinition SourceGcsConfigurationStreamFormatCsvFormatHeaderDefinition

How headers will be defined. User Provided assumes the CSV does not have a header row and uses the headers provided and Autogenerated assumes the CSV does not have a header row and the CDK will generate headers using for f{i} where i is the index starting from 0. Else, the default behavior is to use the header from the CSV file. If a user wants to autogenerate or provide column names for a CSV having headers, they can skip rows.

IgnoreErrorsOnFieldsMismatch bool

Whether to ignore errors that occur when the number of fields in the CSV does not match the number of columns in the schema. Default: false

NullValues List<string>

A set of case-sensitive strings that should be interpreted as null values. For example, if the value 'NA' should be interpreted as null, enter 'NA' in this field.

QuoteChar string

The character used for quoting CSV values. To disallow quoting, make this field blank. Default: """

SkipRowsAfterHeader double

The number of rows to skip after the header row. Default: 0

SkipRowsBeforeHeader double

The number of rows to skip before the header row. For example, if the header row is on the 3rd row, enter 2 in this field. Default: 0

StringsCanBeNull bool

Whether strings can be interpreted as null values. If true, strings that match the nullvalues set will be interpreted as null. If false, strings that match the nullvalues set will be interpreted as the string itself. Default: true

TrueValues List<string>

A set of case-sensitive strings that should be interpreted as true values.

Delimiter string

The character delimiting individual cells in the CSV data. This may only be a 1-character string. For tab-delimited data enter '\t'. Default: ","

DoubleQuote bool

Whether two quotes in a quoted CSV value denote a single quote in the data. Default: true

Encoding string

The character encoding of the CSV data. Leave blank to default to \n\nUTF8\n\n. See \n\nlist of python encodings\n\n for allowable options. Default: "utf8"

EscapeChar string

The character used for escaping special characters. To disallow escaping, leave this field blank.

FalseValues []string

A set of case-sensitive strings that should be interpreted as false values.

HeaderDefinition SourceGcsConfigurationStreamFormatCsvFormatHeaderDefinition

How headers will be defined. User Provided assumes the CSV does not have a header row and uses the headers provided and Autogenerated assumes the CSV does not have a header row and the CDK will generate headers using for f{i} where i is the index starting from 0. Else, the default behavior is to use the header from the CSV file. If a user wants to autogenerate or provide column names for a CSV having headers, they can skip rows.

IgnoreErrorsOnFieldsMismatch bool

Whether to ignore errors that occur when the number of fields in the CSV does not match the number of columns in the schema. Default: false

NullValues []string

A set of case-sensitive strings that should be interpreted as null values. For example, if the value 'NA' should be interpreted as null, enter 'NA' in this field.

QuoteChar string

The character used for quoting CSV values. To disallow quoting, make this field blank. Default: """

SkipRowsAfterHeader float64

The number of rows to skip after the header row. Default: 0

SkipRowsBeforeHeader float64

The number of rows to skip before the header row. For example, if the header row is on the 3rd row, enter 2 in this field. Default: 0

StringsCanBeNull bool

Whether strings can be interpreted as null values. If true, strings that match the nullvalues set will be interpreted as null. If false, strings that match the nullvalues set will be interpreted as the string itself. Default: true

TrueValues []string

A set of case-sensitive strings that should be interpreted as true values.

delimiter String

The character delimiting individual cells in the CSV data. This may only be a 1-character string. For tab-delimited data enter '\t'. Default: ","

doubleQuote Boolean

Whether two quotes in a quoted CSV value denote a single quote in the data. Default: true

encoding String

The character encoding of the CSV data. Leave blank to default to \n\nUTF8\n\n. See \n\nlist of python encodings\n\n for allowable options. Default: "utf8"

escapeChar String

The character used for escaping special characters. To disallow escaping, leave this field blank.

falseValues List<String>

A set of case-sensitive strings that should be interpreted as false values.

headerDefinition SourceGcsConfigurationStreamFormatCsvFormatHeaderDefinition

How headers will be defined. User Provided assumes the CSV does not have a header row and uses the headers provided and Autogenerated assumes the CSV does not have a header row and the CDK will generate headers using for f{i} where i is the index starting from 0. Else, the default behavior is to use the header from the CSV file. If a user wants to autogenerate or provide column names for a CSV having headers, they can skip rows.

ignoreErrorsOnFieldsMismatch Boolean

Whether to ignore errors that occur when the number of fields in the CSV does not match the number of columns in the schema. Default: false

nullValues List<String>

A set of case-sensitive strings that should be interpreted as null values. For example, if the value 'NA' should be interpreted as null, enter 'NA' in this field.

quoteChar String

The character used for quoting CSV values. To disallow quoting, make this field blank. Default: """

skipRowsAfterHeader Double

The number of rows to skip after the header row. Default: 0

skipRowsBeforeHeader Double

The number of rows to skip before the header row. For example, if the header row is on the 3rd row, enter 2 in this field. Default: 0

stringsCanBeNull Boolean

Whether strings can be interpreted as null values. If true, strings that match the nullvalues set will be interpreted as null. If false, strings that match the nullvalues set will be interpreted as the string itself. Default: true

trueValues List<String>

A set of case-sensitive strings that should be interpreted as true values.

delimiter string

The character delimiting individual cells in the CSV data. This may only be a 1-character string. For tab-delimited data enter '\t'. Default: ","

doubleQuote boolean

Whether two quotes in a quoted CSV value denote a single quote in the data. Default: true

encoding string

The character encoding of the CSV data. Leave blank to default to \n\nUTF8\n\n. See \n\nlist of python encodings\n\n for allowable options. Default: "utf8"

escapeChar string

The character used for escaping special characters. To disallow escaping, leave this field blank.

falseValues string[]

A set of case-sensitive strings that should be interpreted as false values.

headerDefinition SourceGcsConfigurationStreamFormatCsvFormatHeaderDefinition

How headers will be defined. User Provided assumes the CSV does not have a header row and uses the headers provided and Autogenerated assumes the CSV does not have a header row and the CDK will generate headers using for f{i} where i is the index starting from 0. Else, the default behavior is to use the header from the CSV file. If a user wants to autogenerate or provide column names for a CSV having headers, they can skip rows.

ignoreErrorsOnFieldsMismatch boolean

Whether to ignore errors that occur when the number of fields in the CSV does not match the number of columns in the schema. Default: false

nullValues string[]

A set of case-sensitive strings that should be interpreted as null values. For example, if the value 'NA' should be interpreted as null, enter 'NA' in this field.

quoteChar string

The character used for quoting CSV values. To disallow quoting, make this field blank. Default: """

skipRowsAfterHeader number

The number of rows to skip after the header row. Default: 0

skipRowsBeforeHeader number

The number of rows to skip before the header row. For example, if the header row is on the 3rd row, enter 2 in this field. Default: 0

stringsCanBeNull boolean

Whether strings can be interpreted as null values. If true, strings that match the nullvalues set will be interpreted as null. If false, strings that match the nullvalues set will be interpreted as the string itself. Default: true

trueValues string[]

A set of case-sensitive strings that should be interpreted as true values.

delimiter str

The character delimiting individual cells in the CSV data. This may only be a 1-character string. For tab-delimited data enter '\t'. Default: ","

double_quote bool

Whether two quotes in a quoted CSV value denote a single quote in the data. Default: true

encoding str

The character encoding of the CSV data. Leave blank to default to \n\nUTF8\n\n. See \n\nlist of python encodings\n\n for allowable options. Default: "utf8"

escape_char str

The character used for escaping special characters. To disallow escaping, leave this field blank.

false_values Sequence[str]

A set of case-sensitive strings that should be interpreted as false values.

header_definition SourceGcsConfigurationStreamFormatCsvFormatHeaderDefinition

How headers will be defined. User Provided assumes the CSV does not have a header row and uses the headers provided and Autogenerated assumes the CSV does not have a header row and the CDK will generate headers using for f{i} where i is the index starting from 0. Else, the default behavior is to use the header from the CSV file. If a user wants to autogenerate or provide column names for a CSV having headers, they can skip rows.

ignore_errors_on_fields_mismatch bool

Whether to ignore errors that occur when the number of fields in the CSV does not match the number of columns in the schema. Default: false

null_values Sequence[str]

A set of case-sensitive strings that should be interpreted as null values. For example, if the value 'NA' should be interpreted as null, enter 'NA' in this field.

quote_char str

The character used for quoting CSV values. To disallow quoting, make this field blank. Default: """

skip_rows_after_header float

The number of rows to skip after the header row. Default: 0

skip_rows_before_header float

The number of rows to skip before the header row. For example, if the header row is on the 3rd row, enter 2 in this field. Default: 0

strings_can_be_null bool

Whether strings can be interpreted as null values. If true, strings that match the nullvalues set will be interpreted as null. If false, strings that match the nullvalues set will be interpreted as the string itself. Default: true

true_values Sequence[str]

A set of case-sensitive strings that should be interpreted as true values.

delimiter String

The character delimiting individual cells in the CSV data. This may only be a 1-character string. For tab-delimited data enter '\t'. Default: ","

doubleQuote Boolean

Whether two quotes in a quoted CSV value denote a single quote in the data. Default: true

encoding String

The character encoding of the CSV data. Leave blank to default to \n\nUTF8\n\n. See \n\nlist of python encodings\n\n for allowable options. Default: "utf8"

escapeChar String

The character used for escaping special characters. To disallow escaping, leave this field blank.

falseValues List<String>

A set of case-sensitive strings that should be interpreted as false values.

headerDefinition Property Map

How headers will be defined. User Provided assumes the CSV does not have a header row and uses the headers provided and Autogenerated assumes the CSV does not have a header row and the CDK will generate headers using for f{i} where i is the index starting from 0. Else, the default behavior is to use the header from the CSV file. If a user wants to autogenerate or provide column names for a CSV having headers, they can skip rows.

ignoreErrorsOnFieldsMismatch Boolean

Whether to ignore errors that occur when the number of fields in the CSV does not match the number of columns in the schema. Default: false

nullValues List<String>

A set of case-sensitive strings that should be interpreted as null values. For example, if the value 'NA' should be interpreted as null, enter 'NA' in this field.

quoteChar String

The character used for quoting CSV values. To disallow quoting, make this field blank. Default: """

skipRowsAfterHeader Number

The number of rows to skip after the header row. Default: 0

skipRowsBeforeHeader Number

The number of rows to skip before the header row. For example, if the header row is on the 3rd row, enter 2 in this field. Default: 0

stringsCanBeNull Boolean

Whether strings can be interpreted as null values. If true, strings that match the nullvalues set will be interpreted as null. If false, strings that match the nullvalues set will be interpreted as the string itself. Default: true

trueValues List<String>

A set of case-sensitive strings that should be interpreted as true values.

Autogenerated SourceGcsConfigurationStreamFormatCsvFormatHeaderDefinitionAutogenerated

FromCsv SourceGcsConfigurationStreamFormatCsvFormatHeaderDefinitionFromCsv

UserProvided SourceGcsConfigurationStreamFormatCsvFormatHeaderDefinitionUserProvided