PinnedExecuting and Scheduling Data Science Notebooks in OCIIn this post we will look at the architecture for orchestrating and scheduling OCI Data Science notebooks as part of other data pipelines in OCI Data Integration. Check out the blog post here Executing and Scheduling Data Science Notebooks in OCI In this post we will look at the architecture for orchestrating and scheduling OCI Data Science notebooks as part of…blogs.oracle.com Would love to hear any comments, ideas and feedback.Jupyter Notebook1 min readJupyter Notebook1 min read
PinnedContainer Instances — Run Dockerized ETL in Data IntegrationHave you heard about the OCI Container Instances service? See the release blog here. They are a great way for running custom jobs in a serverless manner. Often I see requests of how do I run some custom python in the cloud, how can I run an Essbase MAXL script…Containers6 min readContainers6 min read
Apr 27Orchestration and Scheduling in OCIAs technology advances, so does the need for efficient and reliable data integration. The use of cloud computing has made it easier for organizations to store and manage their data, and Oracle Cloud Infrastructure (OCI) provides a suite of powerful tools for data integration orchestration and scheduling. If you’re currently…Schedule6 min readSchedule6 min read
Apr 21Cross-tenancy access in OCI Data IntegrationIn OCI Data Integration some operations for resources need user authentication, the user authentication is used mostly in the OCI Console when designing artifacts. Resource principal is primarily used at runtime as there is no user authentication token, these are jobs that get scheduled and run in a headless manner. …Oci3 min readOci3 min read
Apr 17Global variables — wait on Data and application state using Oracle NoSQLThis best practice shows how to save variable state for applications in OCI NoSQL. This can be easily shared across your applications. Within data integration there is often the need to trigger processing with time and also with some data, when data or some data values arrive in a data…NoSQL4 min readNoSQL4 min read
Apr 12OCI CLI and Containers- the simplest things are the bestAren’t the best things, the simplest things? When you join 1 + 1 and get much much more! We’re going to see how you can run any set of commands in a serverless manner in OCI. Let’s see where we go here….. Oracle Cloud Infrastructure (OCI) is a cloud platform…Cli7 min readCli7 min read
Mar 23Copying Objects in OCI Data IntegrationOCI Data Integration has the capability to easily copy objects, whether its design objects like data assets, dataflows, pipelines, the many tasks or your runtime applications. This is really useful whether you want to take a snapshot of your work when moving between development to test phases or whether you…Data Integration3 min readData Integration3 min read
Mar 22Types and Higher Order Functions in OCI Data IntegrationOCI Data Integration supports processing of files with nested hierarchy and data types, in this blog we will look at the datatypes and higher order functions specifically related to nested hierarchy types and JSON; Composite Type — a struct, a way to group several related properties into one place. Each…Higher Order Function5 min readHigher Order Function5 min read
Mar 10Serverless Data Copy into OCI Object StorageIn this post we will look at using Rclone and the OCI Container Instance service to provide a completely serverless and cloud native solution for migrating and synchronizing data in a multi cloud environment. You will be able to copy from other clouds, from your on-premise file servers via SFTP…7 min read7 min read
Mar 1Loading SOAP results into OCI Object Storage?Let’s see how we can make a SOAP call and upload the result into OCI Object Storage. This leverages the python zeep library which gives an easy to use interface to SOAP based services. There are tonnes of SOAP based services, the example below lists country info, Oracle UCM also…2 min read2 min read
