David Allan – Medium

David Allan

Pinned

Executing and Scheduling Data Science Notebooks in OCI

In this post we will look at the architecture for orchestrating and scheduling OCI Data Science notebooks as part of other data pipelines…

Mar 31, 2023

Mar 31, 2023

Pinned

Container Instances — Run Dockerized ETL in Data Integration

Have you heard about the OCI Container Instances service? See the release blog here. They are a great way for running custom jobs in a…

Jan 6, 2023

Container Instances — Run Dockerized ETL in Data Integration

Jan 6, 2023

Check Last Run State in OCI Data Integration

This blog post shows a useful REST task that can be used in your pipelines for checking the last run state of a task run in OCI Data…

Aug 27, 2024

Check Last Run State in OCI Data Integration

Aug 27, 2024

Integrating Oracle Fusion Applications with OCI Data Integration: A Guide to Data Extraction and…

In today’s fast-paced digital environment, organizations rely on accurate and timely data to make informed decisions. Oracle Fusion…

Aug 15, 2024

Integrating Oracle Fusion Applications with OCI Data Integration: A Guide to Data Extraction and…

Aug 15, 2024

Retry with Backoff Pattern in OCI

A standard pattern for improving application stability is to retry with backoff certain operations that fail. Let’s look at how to do this…

Jun 12, 2024

Retry with Backoff Pattern in OCI

Jun 12, 2024

Automating Task Termination on SLA Miss and Best Practices

In this post we will see how to leverage OCI Events to terminate a long running task that has missed an SLA. Within task schedules and…

Jun 7, 2024

Automating Task Termination on SLA Miss and Best Practices

Jun 7, 2024

Leveraging dbt with OCI Dataflow: Supercharging Your Data Analytics Workflow on OCI

In the realm of modern data analytics, the tools and technologies available continue to evolve rapidly, offering more efficient and…

Jan 31, 2024

Leveraging dbt with OCI Dataflow: Supercharging Your Data Analytics Workflow on OCI

Jan 31, 2024

Notebooks, Big Data and Spark Jobs in OCI — Best Practices and Examples

This blog explores the integration of notebooks commonly used for data science and big data on Oracle Cloud Infrastructure (OCI).

Dec 9, 2023

Notebooks, Big Data and Spark Jobs in OCI — Best Practices and Examples

Dec 9, 2023

Exporting and Importing in OCI Data Integration

The objects in OCI Data Integration can be exported and imported between workspaces, that goes for design objects in projects or published…

Oct 17, 2023

Exporting and Importing in OCI Data Integration

Oct 17, 2023

Easily Copy Data into OCI Object Storage

Are you looking to export large tables fast from any JDBC compliant source, this could be data systems like Snowflake or applications like…

Oct 10, 2023

Easily Copy Data into OCI Object Storage

Oct 10, 2023

Create OCI Task Schedules from Excel

Often the scheduling of your tasks is captured in Excel spreadsheets, rather than keying this in again, let’s see how we can automate this…

Aug 31, 2023

Create OCI Task Schedules from Excel

Aug 31, 2023

Best Practices in OCI Data Integration

Note the following best practices when designing a data integrations.

Aug 28, 2023

Best Practices in OCI Data Integration

Aug 28, 2023

Hi Idan

There's a postman collection here that creates the REST Tasks I have used, the one in here polls;

Jul 7, 2023

Jul 7, 2023

Multi-Cloud: Copying Data from Azure Data Lake to Oracle’s OCI Object Storage using OCI Data Flow

In today’s digital landscape, organizations often find themselves working with multiple cloud providers to leverage the best features and…

Jun 13, 2023

Multi-Cloud: Copying Data from Azure Data Lake to Oracle’s OCI Object Storage using OCI Data Flow

Jun 13, 2023

Orchestration and Scheduling in OCI

As technology advances, so does the need for efficient and reliable data integration. The use of cloud computing has made it easier for…

Apr 27, 2023

Orchestration and Scheduling in OCI

Apr 27, 2023

Cross-tenancy access in OCI Data Integration

In OCI Data Integration some operations for resources need user authentication, the user authentication is used mostly in the OCI Console…

Apr 21, 2023

Cross-tenancy access in OCI Data Integration

Apr 21, 2023

Global variables — wait on Data and application state using Oracle NoSQL

This best practice shows how to save variable state for applications in OCI NoSQL. This can be easily shared across your applications…

Apr 17, 2023

Global variables — wait on Data and application state using Oracle NoSQL

Apr 17, 2023

OCI CLI and Containers- the simplest things are the best

Aren’t the best things, the simplest things? When you join 1 + 1 and get much much more! We’re going to see how you can run any set of…

Apr 12, 2023

OCI CLI and Containers- the simplest things are the best

Apr 12, 2023

Copying Objects in OCI Data Integration

OCI Data Integration has the capability to easily copy objects, whether its design objects like data assets, dataflows, pipelines, the many…

Mar 23, 2023

Copying Objects in OCI Data Integration

Mar 23, 2023

Types and Higher Order Functions in OCI Data Integration

OCI Data Integration supports processing of files with nested hierarchy and data types, in this blog we will look at the datatypes and…

Mar 22, 2023

Types and Higher Order Functions in OCI Data Integration

Mar 22, 2023

David Allan

David Allan

Architect at @Oracle The views expressed on this blog are my own and do not necessarily reflect the views of Oracle.

Following

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams