Data Loading, Unloading, and Connectivity

A data engineer runs a bulk COPY INTO command to load 500 CSV files into a table. The load completed, but the engineer suspects some rows were rejected due to data type mismatches. They want to retrieve the specific rows that failed during that most recent load so they can investigate the raw values. Which approach should they use?

A data engineer runs COPY INTO on a table from an internal named stage that already contains 50 files. The load completes successfully. Later that day, the same 50 files plus 10 new files are present in the stage, and the engineer reruns the identical COPY INTO command without any options that alter default behavior. What happens?

A data engineer runs COPY INTO to unload a very large query result to an external S3 stage. They omit the SINGLE option (leaving the default) and do not set MAX_FILE_SIZE. After the unload, they observe many output files rather than one. A downstream partner requires that no individual output file exceed 100 MB. Which action correctly enforces this requirement?

A data engineer used the PUT command to upload three CSV files to their user stage. They now want to load only one specific file, sales_west.csv, into the WEST_SALES table using a predefined file format named CSV_FMT. Which COPY INTO statement correctly loads just that single file from the user stage?

A data engineer is loading Parquet files into a Snowflake table using COPY INTO. The Parquet files contain named columns, but the physical column order in the files does not match the column order defined in the target table. The engineer wants Snowflake to map source fields to table columns based on their names rather than their position. Which COPY INTO option should be used?

A data engineer runs a COPY INTO command to bulk load 50 CSV files from a named internal stage into a target table. Several rows across multiple files contain formatting errors that will cause parsing failures. The business requirement is that all valid rows must be loaded, and only the individual problematic rows should be skipped without aborting the load. Which ON_ERROR option should be specified in the COPY INTO command?

A data engineer is loading a CSV file from a named internal stage into a target table. The source file has columns in the order (id, raw_timestamp, amount), but the target table columns are (amount, event_id, event_time), and the team wants to cast raw_timestamp to a TIMESTAMP and multiply amount by 100 during the load. Which approach lets them accomplish this in a single COPY INTO statement?

A data engineer needs to unload a large fact table from Snowflake to an external S3 stage. Downstream systems require the output to be plain, uncompressed CSV files (no GZIP), and the team wants each file kept under 100 MB to parallelize downstream reads. Which COPY INTO <location> configuration meets these requirements?

A data engineer must unload a large fact table to an external S3 stage. The downstream analytics team requires that the exported files be organized into subfolders by region and load date (for example, region=US/dt=2024-01-15/) so their partition-aware query engine can prune efficiently. Which approach in a single COPY INTO <location> statement produces this folder structure?

A data engineer is preparing to bulk load a large batch of CSV files from a named internal stage into a target table using COPY INTO. Before committing the load, they want to detect any data type mismatches or malformed rows without actually inserting any data into the table. Which approach should they use?

A data engineer creates an external table over Parquet files stored in an Amazon S3 bucket. New files are added to the bucket by an upstream process several times per hour, and the team needs the external table's metadata to reflect newly added files automatically, without manual intervention. Which configuration should the engineer implement?

A data engineer used COPY INTO to unload query results into files in a named internal stage. They now need to download those files from the stage to their local workstation for offline inspection. Which command should they run from SnowSQL?

A data analytics team runs a legacy on-premises reporting application written in C++ that connects to databases using a standard native interface. They need to query Snowflake from this application with minimal code changes. Separately, a Java-based ETL microservice must also connect to Snowflake to run queries. Which combination of Snowflake drivers should the team use for these two applications?

A data engineering team is streaming clickstream events from Apache Kafka topics into Snowflake. They require the lowest possible ingestion latency (seconds, not minutes) and want to minimize per-file overhead and storage of intermediate files in a stage. Which configuration of the Snowflake Kafka connector should they use?

A data engineer runs several COPY INTO commands each day to load pipe-delimited files that all share the same field delimiter, compression, and date format settings. To avoid repeating these settings in every COPY statement and to centrally manage them, what should the engineer create?

A development team is building a customer-facing web application on Node.js. The backend must execute queries against Snowflake, stream result rows asynchronously, and integrate naturally with the application's existing event-driven JavaScript codebase. Which Snowflake connectivity option best fits these requirements?

A data engineer is working from their laptop and needs to upload a set of compressed CSV files from a local directory into their user stage before running a COPY INTO command. They are connected to Snowflake using the SnowSQL client. Which command should they use to move the files from their local machine to the user stage?

A data engineer is writing a Python automation script that must upload several local CSV files from the application server into an existing internal named stage, then trigger a bulk load into a table. They want to execute the file transfer programmatically without shelling out to SnowSQL. Which approach correctly moves the local files into the stage from within the Python Connector?

A data engineer is building a Python application that processes data into a pandas DataFrame and needs to load approximately 5 million rows into an existing Snowflake table as efficiently as possible. They are already using the Snowflake Connector for Python. Which approach should they use to load the DataFrame with the least custom code while maximizing throughput?

A data engineering team stores CSV files in an AWS S3 bucket that is configured as an external stage. New files arrive continuously throughout the day, and the team needs them loaded into Snowflake within about a minute of arrival, without running any scheduled COPY jobs or scripts. They want the most cost-efficient, hands-off ingestion mechanism. Which approach should they implement?