Skip to content
This repository has been archived by the owner on Jan 16, 2023. It is now read-only.

Commit

Permalink
Introducing Airbyte (airbytehq#348)
Browse files Browse the repository at this point in the history
  • Loading branch information
michel-tricot authored Sep 19, 2020
1 parent c2b96ee commit e3737a2
Show file tree
Hide file tree
Showing 544 changed files with 1,662 additions and 1,663 deletions.
4 changes: 2 additions & 2 deletions .env
Original file line number Diff line number Diff line change
@@ -1,10 +1,10 @@
VERSION=0.1.0
DATABASE_USER=docker
DATABASE_PASSWORD=docker
DATABASE_DB=dataline
DATABASE_DB=airbyte
CONFIG_ROOT=/data
WORKSPACE_ROOT=/tmp/workspace
WORKSPACE_DOCKER_MOUNT=workspace
LOCAL_ROOT=/tmp/dataline_local
LOCAL_ROOT=/tmp/airbyte_local
LOCAL_DOCKER_MOUNT=local
TRACKING_STRATEGY=segment
4 changes: 2 additions & 2 deletions .env.dev
Original file line number Diff line number Diff line change
Expand Up @@ -3,11 +3,11 @@
VERSION=dev
DATABASE_USER=docker
DATABASE_PASSWORD=docker
DATABASE_DB=dataline
DATABASE_DB=airbyte
DEV_ROOT=/tmp/dev_root
CONFIG_ROOT=/tmp/data
WORKSPACE_ROOT=/tmp/workspace
WORKSPACE_DOCKER_MOUNT=dev-workspace
LOCAL_ROOT=/tmp/dataline_local
LOCAL_ROOT=/tmp/airbyte_local
LOCAL_DOCKER_MOUNT=dev-local
TRACKING_STRATEGY=logging
6 changes: 3 additions & 3 deletions .github/workflows/gradle.yml
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
name: Dataline CI
name: Airbyte CI

on: push

Expand All @@ -8,7 +8,7 @@ jobs:
GRADLE_PATH: /tmp/gradle
runs-on: ubuntu-latest
steps:
- name: Checkout Dataline
- name: Checkout Airbyte
uses: actions/checkout@v2

- name: Cache java deps
Expand Down Expand Up @@ -62,7 +62,7 @@ jobs:
- name: Push Core Docker Images
if: success() && github.ref == 'refs/heads/master'
run: |
docker login -u datalinebot -p ${DOCKER_PASSWORD}
docker login -u airbytebot -p ${DOCKER_PASSWORD}
docker-compose -f docker-compose.build.yaml push
env:
DOCKER_PASSWORD: ${{ secrets.DOCKER_PASSWORD }}
Expand Down
1 change: 0 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -3,5 +3,4 @@
build
!tools/build
.DS_Store
dataline-db/pg_data/*
data
2 changes: 1 addition & 1 deletion CODE_OF_CONDUCT.md
Original file line number Diff line number Diff line change
@@ -1,2 +1,2 @@
# Code of conduct
View in [docs.dataline.io](https://docs.dataline.io/contributing/contributing-to-dataline/code-of-conduct)
View in [docs.airbyte.io](https://docs.airbyte.io/contributing/contributing-to-airbyte/code-of-conduct)
2 changes: 1 addition & 1 deletion CONTRIBUTING.md
Original file line number Diff line number Diff line change
@@ -1,2 +1,2 @@
# Contributing
View on [docs.dataline.io](https://docs.dataline.io/contributing/contributing-to-dataline)
View on [docs.airbyte.io](https://docs.airbyte.io/contributing/contributing-to-airbyte)
2 changes: 1 addition & 1 deletion LICENSE
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
MIT License

Copyright (c) 2020 Dataline
Copyright (c) 2020 Airbyte

Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
Expand Down
30 changes: 15 additions & 15 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,21 +1,21 @@
# Getting Started

![GitHub Workflow Status](https://img.shields.io/github/workflow/status/datalineio/dataline/Dataline%20CI) ![License](https://img.shields.io/github/license/datalineio/dataline)
![GitHub Workflow Status](https://img.shields.io/github/workflow/status/airbytehq/airbyte/Airbyte%20CI) ![License](https://img.shields.io/github/license/airbytehq/airbyte)

[![](docs/.gitbook/assets/dataline_light-background.svg)](https://dataline.io)
[![](docs/.gitbook/assets/airbyte_light-background.svg)](https://airbyte.io)

### Data integration made simple, secure and reliable.

The new open-source standard to sync data from applications & databases to warehouses.

[![](docs/.gitbook/assets/deploy-locally.svg)](https://docs.dataline.io/deployment/deploying-dataline/with-docker) [![](docs/.gitbook/assets/deploy-on-aws.svg)](https://docs.dataline.io/deployment/deploying-dataline/on-aws-ec2) [![](docs/.gitbook/assets/deploy-on-gcp.svg)](https://docs.dataline.io/deployment/deploying-dataline/on-gcp-compute-engine)
[![](docs/.gitbook/assets/deploy-locally.svg)](https://docs.airbyte.io/deployment/deploying-airbyte/with-docker) [![](docs/.gitbook/assets/deploy-on-aws.svg)](https://docs.airbyte.io/deployment/deploying-airbyte/on-aws-ec2) [![](docs/.gitbook/assets/deploy-on-gcp.svg)](https://docs.airbyte.io/deployment/deploying-airbyte/on-gcp-compute-engine)

![](docs/.gitbook/assets/sources_list.png)

Dataline is on a mission to make data integration pipelines a commodity.
Airbyte is on a mission to make data integration pipelines a commodity.

* **Maintenance-free connectors you can use in minutes**. Just authenticate your sources and warehouse, and get connectors that adapts to schema and API changes for you.
* On a mission to **cover the long tail of integrations**, as Dataline will be very active in maintaining the pipelines’ reliability.
* On a mission to **cover the long tail of integrations**, as Airbyte will be very active in maintaining the pipelines’ reliability.
* **Building new integrations made trivial**. We make it very easy to add new integrations that you need, by offering scheduling and orchestration.
* **Your data stays in your cloud**. Have full control over your data, and the costs of your data transfers.
* **No more security compliance process** to go through as self-hosted.
Expand All @@ -26,8 +26,8 @@ Dataline is on a mission to make data integration pipelines a commodity.
### Quick start

```bash
git clone [email protected]:datalineio/dataline.git
cd dataline
git clone [email protected]:airbytehq/airbyte.git
cd airbyte
docker-compose up
```

Expand All @@ -42,25 +42,25 @@ Now visit [http://localhost:8000](http://localhost:8000)
* **Manual full refresh**: Sometimes, you need to re-sync all your data to start again.
* **Granular system logs**: No opacity whatsoever to let you control and trust.

[See more on our website.](https://dataline.io/features/)
[See more on our website.](https://airbyte.io/features/)

## Contributing

We love contributions to Dataline, big or small. See our [Contributing Guide](https://docs.dataline.io/contributing/contributing-to-dataline) on how to get started. Not sure where to start? We’ve listed some [good first issues](https://github.com/datalineio/dataline/labels/good%20first%20issue) to start with. You can also [book a free, no-pressure pairing session](https://drift.me/micheltricot/meeting) with one of our core contributors.
We love contributions to Airbyte, big or small. See our [Contributing Guide](https://docs.airbyte.io/contributing/contributing-to-airbyte) on how to get started. Not sure where to start? We’ve listed some [good first issues](https://github.com/airbytehq/airbyte/labels/good%20first%20issue) to start with. You can also [book a free, no-pressure pairing session](https://drift.me/micheltricot/meeting) with one of our core contributors.

## Community support

For general help using Dataline, please refer to the official Dataline documentation. For additional help, you can use one of these channels to ask a question:
For general help using Airbyte, please refer to the official Airbyte documentation. For additional help, you can use one of these channels to ask a question:

* [Slack](https://join.slack.com/t/datalinehq/shared_invite/zt-h5m88w3a-twQ_6AF9e8SnAzOIkHu2VQ) \(For live discussion with the Community and Dataline team\)
* [GitHub](https://github.com/datalineio/dataline) \(Bug reports, Contributions\)
* [Twitter](https://twitter.com/datalinehq) \(Get the news fast\)
* [Slack](https://join.slack.com/t/airbytehq/shared_invite/zt-h5m88w3a-twQ_6AF9e8SnAzOIkHu2VQ) \(For live discussion with the Community and Airbyte team\)
* [GitHub](https://github.com/airbytehq/airbyte) \(Bug reports, Contributions\)
* [Twitter](https://twitter.com/airbytehq) \(Get the news fast\)

## Roadmap

Check out our [roadmap](https://github.com/datalineio/dataline/projects/1) to get informed of the latest features released and the upcoming ones. You may also give us insights and vote for a specific feature. For our high-level roadmap and strategy, you can check [our handbook](https://docs.dataline.io/company-handbook/company-handbook/roadmap).
Check out our [roadmap](https://github.com/airbytehq/airbyte/projects/1) to get informed of the latest features released and the upcoming ones. You may also give us insights and vote for a specific feature. For our high-level roadmap and strategy, you can check [our handbook](https://docs.airbyte.io/company-handbook/company-handbook/roadmap).

## License

Dataline is licensed under the MIT license. See the [LICENSE](https://docs.dataline.io/license) file for licensing information.
Airbyte is licensed under the MIT license. See the [LICENSE](https://docs.airbyte.io/license) file for licensing information.

7 changes: 7 additions & 0 deletions airbyte-analytics/build.gradle
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
dependencies {
implementation 'com.segment.analytics.java:analytics:2.1.1'


implementation project(':airbyte-config:models')
implementation project(':airbyte-config:persistence')
}
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
/*
* MIT License
*
* Copyright (c) 2020 Dataline
* Copyright (c) 2020 Airbyte
*
* Permission is hereby granted, free of charge, to any person obtaining a copy
* of this software and associated documentation files (the "Software"), to deal
Expand All @@ -22,7 +22,7 @@
* SOFTWARE.
*/

package io.dataline.analytics;
package io.airbyte.analytics;

import java.util.Collections;
import java.util.Map;
Expand Down
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
/*
* MIT License
*
* Copyright (c) 2020 Dataline
* Copyright (c) 2020 Airbyte
*
* Permission is hereby granted, free of charge, to any person obtaining a copy
* of this software and associated documentation files (the "Software"), to deal
Expand All @@ -22,7 +22,7 @@
* SOFTWARE.
*/

package io.dataline.analytics;
package io.airbyte.analytics;

import com.google.common.annotations.VisibleForTesting;
import com.google.common.collect.ImmutableMap;
Expand Down
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
/*
* MIT License
*
* Copyright (c) 2020 Dataline
* Copyright (c) 2020 Airbyte
*
* Permission is hereby granted, free of charge, to any person obtaining a copy
* of this software and associated documentation files (the "Software"), to deal
Expand All @@ -22,7 +22,7 @@
* SOFTWARE.
*/

package io.dataline.analytics;
package io.airbyte.analytics;

import java.util.Map;

Expand Down
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
/*
* MIT License
*
* Copyright (c) 2020 Dataline
* Copyright (c) 2020 Airbyte
*
* Permission is hereby granted, free of charge, to any person obtaining a copy
* of this software and associated documentation files (the "Software"), to deal
Expand All @@ -22,15 +22,15 @@
* SOFTWARE.
*/

package io.dataline.analytics;
package io.airbyte.analytics;

import com.google.common.annotations.VisibleForTesting;
import io.dataline.commons.json.JsonValidationException;
import io.dataline.config.Configs;
import io.dataline.config.StandardWorkspace;
import io.dataline.config.persistence.ConfigNotFoundException;
import io.dataline.config.persistence.ConfigRepository;
import io.dataline.config.persistence.PersistenceConstants;
import io.airbyte.commons.json.JsonValidationException;
import io.airbyte.config.Configs;
import io.airbyte.config.StandardWorkspace;
import io.airbyte.config.persistence.ConfigNotFoundException;
import io.airbyte.config.persistence.ConfigRepository;
import io.airbyte.config.persistence.PersistenceConstants;
import java.io.IOException;
import java.util.function.Supplier;

Expand Down
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
/*
* MIT License
*
* Copyright (c) 2020 Dataline
* Copyright (c) 2020 Airbyte
*
* Permission is hereby granted, free of charge, to any person obtaining a copy
* of this software and associated documentation files (the "Software"), to deal
Expand All @@ -22,7 +22,7 @@
* SOFTWARE.
*/

package io.dataline.analytics;
package io.airbyte.analytics;

import java.util.Objects;
import java.util.Optional;
Expand Down
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
/*
* MIT License
*
* Copyright (c) 2020 Dataline
* Copyright (c) 2020 Airbyte
*
* Permission is hereby granted, free of charge, to any person obtaining a copy
* of this software and associated documentation files (the "Software"), to deal
Expand All @@ -22,7 +22,7 @@
* SOFTWARE.
*/

package io.dataline.analytics;
package io.airbyte.analytics;

import static org.junit.jupiter.api.Assertions.assertEquals;
import static org.mockito.Mockito.mock;
Expand All @@ -40,7 +40,7 @@

class SegmentTrackingClientTest {

private static final TrackingIdentity identity = new TrackingIdentity(UUID.randomUUID(), "a@dataline.io", false, false, true);
private static final TrackingIdentity identity = new TrackingIdentity(UUID.randomUUID(), "a@airbyte.io", false, false, true);

private Analytics analytics;
private SegmentTrackingClient segmentTrackingClient;
Expand Down
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
/*
* MIT License
*
* Copyright (c) 2020 Dataline
* Copyright (c) 2020 Airbyte
*
* Permission is hereby granted, free of charge, to any person obtaining a copy
* of this software and associated documentation files (the "Software"), to deal
Expand All @@ -22,19 +22,19 @@
* SOFTWARE.
*/

package io.dataline.analytics;
package io.airbyte.analytics;

import static org.junit.jupiter.api.Assertions.assertEquals;
import static org.junit.jupiter.api.Assertions.assertTrue;
import static org.mockito.Mockito.mock;
import static org.mockito.Mockito.when;

import io.dataline.commons.json.JsonValidationException;
import io.dataline.config.Configs;
import io.dataline.config.StandardWorkspace;
import io.dataline.config.persistence.ConfigNotFoundException;
import io.dataline.config.persistence.ConfigRepository;
import io.dataline.config.persistence.PersistenceConstants;
import io.airbyte.commons.json.JsonValidationException;
import io.airbyte.config.Configs;
import io.airbyte.config.StandardWorkspace;
import io.airbyte.config.persistence.ConfigNotFoundException;
import io.airbyte.config.persistence.ConfigRepository;
import io.airbyte.config.persistence.PersistenceConstants;
import java.io.IOException;
import java.util.UUID;
import org.junit.jupiter.api.BeforeEach;
Expand Down Expand Up @@ -91,7 +91,7 @@ void testGetTrackingIdentityInitialSetupNotComplete() throws JsonValidationExcep
void testGetTrackingIdentityNonAnonymous() throws JsonValidationException, IOException, ConfigNotFoundException {
final StandardWorkspace workspace = new StandardWorkspace()
.withCustomerId(UUID.randomUUID())
.withEmail("a@dataline.io")
.withEmail("a@airbyte.io")
.withAnonymousDataCollection(false)
.withNews(true)
.withSecurityUpdates(true);
Expand All @@ -108,7 +108,7 @@ void testGetTrackingIdentityNonAnonymous() throws JsonValidationException, IOExc
void testGetTrackingIdentityAnonymous() throws JsonValidationException, IOException, ConfigNotFoundException {
final StandardWorkspace workspace = new StandardWorkspace()
.withCustomerId(UUID.randomUUID())
.withEmail("a@dataline.io")
.withEmail("a@airbyte.io")
.withAnonymousDataCollection(true)
.withNews(true)
.withSecurityUpdates(true);
Expand Down
18 changes: 9 additions & 9 deletions dataline-api/build.gradle → airbyte-api/build.gradle
Original file line number Diff line number Diff line change
Expand Up @@ -17,9 +17,9 @@ task generateApiServer(type: GenerateTask) {
inputSpec = specFile
outputDir = serverOutputDir

apiPackage = "io.dataline.api"
invokerPackage = "io.dataline.api.invoker"
modelPackage = "io.dataline.api.model"
apiPackage = "io.airbyte.api"
invokerPackage = "io.airbyte.api.invoker"
modelPackage = "io.airbyte.api.model"

importMappings = [
'SourceSpecification' : 'com.fasterxml.jackson.databind.JsonNode',
Expand Down Expand Up @@ -48,9 +48,9 @@ task generateApiClient(type: GenerateTask) {
inputSpec = specFile
outputDir = clientOutputDir

apiPackage = "io.dataline.api.client"
invokerPackage = "io.dataline.api.client.invoker"
modelPackage = "io.dataline.api.client.model"
apiPackage = "io.airbyte.api.client"
invokerPackage = "io.airbyte.api.client.invoker"
modelPackage = "io.airbyte.api.client.model"

importMappings = [
'SourceSpecification' : 'com.fasterxml.jackson.databind.JsonNode',
Expand Down Expand Up @@ -79,9 +79,9 @@ task generateApiDocs(type: GenerateTask) {
inputSpec = specFile
outputDir = docsOutputDir

apiPackage = "io.dataline.api.client"
invokerPackage = "io.dataline.api.client.invoker"
modelPackage = "io.dataline.api.client.model"
apiPackage = "io.airbyte.api.client"
invokerPackage = "io.airbyte.api.client.invoker"
modelPackage = "io.airbyte.api.client.model"

importMappings = [
'SourceSpecification' : 'com.fasterxml.jackson.databind.JsonNode',
Expand Down
Loading

0 comments on commit e3737a2

Please sign in to comment.