PinnedContainer Instances — Run Dockerized ETL in Data IntegrationHave you heard about the OCI Container Instances service? See the release blog here. They are a great way for running custom jobs in a serverless manner. Often I see requests of how do I run some custom python in the cloud, how can I run an Essbase MAXL script…Containers6 min readContainers6 min read
Jan 24Running scripts in the Oracle CloudHere we see how to execute python scripts stored in OCI Object Storage inside a serverless instance in OCI’s Container Instance Service. You can then run via REST, any supported OCI SDK or from within OCI Data Integration in amongst your other jobs. …4 min read4 min read
Jan 13OCI Data Integration and ORA-30926 or ORA-00001Getting a unique key or unstable row set error during your task runs? More than likely you have more than one input row for the key in the target table. Even if you use merge mode on the target operator you may get this — on Oracle, the SQL Merge…4 min read4 min read
Jan 9Automate Starting and Stopping WorkspaceYou may ask is there a way to automate the stop and start of an OCI Data Integration workspace or any OCI resource that is billed per use. One way to do this is to do this via the Oracle Autonomous databases. The OCI PLSQL SDK is available in all…3 min read3 min read
Jan 3OCI Data Integration REST Tasks — Postman CollectionAs much as I’d like to write about Pinball Blizzard in this fantastic pinball arcade (which was truly awesome — have never seen so many working pinball machines even in the craziest of storms), this post illustrates a sample Postman collection which defines a number of REST Tasks for OCI…5 min read5 min read
Nov 28, 2022Spark Parallel Export from Databases to Object Storage using OCI Data IntegrationIn this blog we will look at leveraging the OCI Dataflow application from this post here from within OCI Data Integration, this application supports parallel export from databases into partitioned data in Object Storage using Apache Spark. …3 min read3 min read
Sep 22, 2022Incremental Extract using OCI Data IntegrationThis solution makes incremental extract and load as simple as possible for the user AND not only for a single source entity but with a metadata driven approach to support many source entities. There’s plenty of users just now asking how do I do this on a single table, how…Plsql6 min readPlsql6 min read
Sep 22, 2022Copying Images and Movies to OCI Object Storage using RcloneThis solution describes how to use Rclone to migrate/copy data from Amazon S3, Microsoft Azure Blob storage and more to an OCI Object Storage bucket. You may want to copy images or movies or any other data from on-premise, S3 or Microsoft Azure Blob storage, so that we can easily…Oci4 min readOci4 min read
Sep 20, 2022DBMS_CLOUD EXPORT_DATA and DBMS_PARALLEL_EXECUTE a match made in the cloud?The Oracle database DBMS_CLOUD package was introduced with Oracle Autonomous databases, it provides lots of very cool procedures for interacting with Object Storage store from the Oracle database. It provides much more and can be used in on-premise installations for versions 19c and 21c (How To Setup And Use DBMS_CLOUD…Oracle4 min readOracle4 min read
Sep 15, 2022Reusing Logic in OCI Data IntegrationThere’s a few concepts within OCI Data Integration that help with reusing logic. Here we will look at two; parameters and rules. Parameters are familiar to us from all programming languages. Rules are a little different but are useful for generically shaping data or generically performing transformations on attributes. Parameters Parameters…5 min read5 min read
