PinnedContainer Instances — Run Dockerized ETL in Data IntegrationHave you heard about the OCI Container Instances service? See the release blog here. They are a great way for running custom jobs in a serverless manner. Often I see requests of how do I run some custom python in the cloud, how can I run an Essbase MAXL script…Containers6 min readContainers6 min read
12 hours agoCopying Objects in OCI Data IntegrationOCI Data Integration has the capability to easily copy objects, whether its design objects like data assets, dataflows, pipelines, the many tasks or your runtime applications. This is really useful whether you want to take a snapshot of your work when moving between development to test phases or whether you…Data Integration3 min readData Integration3 min read
1 day agoTypes and Higher Order Functions in OCI Data IntegrationOCI Data Integration supports processing of files with nested hierarchy and data types, in this blog we will look at the datatypes and higher order functions specifically related to nested hierarchy types and JSON; Composite Type — a struct, a way to group several related properties into one place. Each…Higher Order Function5 min readHigher Order Function5 min read
Mar 10Serverless Data Copy into OCI Object StorageIn this post we will look at using Rclone and the OCI Container Instance service to provide a completely serverless and cloud native solution for migrating and synchronizing data in a multi cloud environment. You will be able to copy from other clouds, from your on-premise file servers via SFTP…7 min read7 min read
Mar 1Loading SOAP results into OCI Object Storage?Let’s see how we can make a SOAP call and upload the result into OCI Object Storage. This leverages the python zeep library which gives an easy to use interface to SOAP based services. There are tonnes of SOAP based services, the example below lists country info, Oracle UCM also…2 min read2 min read
Jan 24Running scripts in the Oracle CloudHere we see how to execute python scripts stored in OCI Object Storage inside a serverless instance in OCI’s Container Instance Service. You can then run via REST, any supported OCI SDK or from within OCI Data Integration in amongst your other jobs. …4 min read4 min read
Jan 13OCI Data Integration and ORA-30926 or ORA-00001Getting a unique key or unstable row set error during your task runs? More than likely you have more than one input row for the key in the target table. Even if you use merge mode on the target operator you may get this — on Oracle, the SQL Merge…4 min read4 min read
Jan 9Automate Starting and Stopping WorkspaceYou may ask is there a way to automate the stop and start of an OCI Data Integration workspace or any OCI resource that is billed per use. One way to do this is to do this via the Oracle Autonomous databases. The OCI PLSQL SDK is available in all…3 min read3 min read
Jan 3OCI Data Integration REST Tasks — Postman CollectionAs much as I’d like to write about Pinball Blizzard in this fantastic pinball arcade (which was truly awesome — have never seen so many working pinball machines even in the craziest of storms), this post illustrates a sample Postman collection which defines a number of REST Tasks for OCI…6 min read6 min read
Nov 28, 2022Spark Parallel Export from Databases to Object Storage using OCI Data IntegrationIn this blog we will look at leveraging the OCI Dataflow application from this post here from within OCI Data Integration, this application supports parallel export from databases into partitioned data in Object Storage using Apache Spark. …3 min read3 min read
