2
0
mirror of https://github.com/VinylDNS/vinyldns synced 2025-08-22 02:02:14 +00:00

666 Commits

Author SHA1 Message Date
Emerle, Ryan
e1743e5342
Updates
- Simplify build config
- Add TTY check to Makefiles for running Docker containers
- Update `fs2` to latest patch
- Update `sbt-assembly` plugin
- Update portal to remove chatty console
- Update portal scripts to add license header
- Update prepare-portal/Gruntfile to combine js and css where applicable
- Remove unused gentelella files from final portal artifact
- Add support for shared zones to quickstart/docker images
- Consolidate built artifacts in `artifacts/` to make eventual release easier
2021-11-02 17:06:24 -04:00
Emerle, Ryan
45e7ce6a6a
Update docker run statements
- Update Makefiles to _optionally_ include TTY
2021-11-01 12:36:21 -04:00
Emerle, Ryan
c4d10a201e
Update Release
- Added images to `build/docker`
- Update `quickstart` script to be more functional
2021-11-01 12:25:17 -04:00
Emerle, Ryan
f2db11e89a
Update Release
- Remove sonatype release from sbt build
- Remove instructions about release - it will be automated by GHA
- Remove `sbt-release` plugin
2021-10-29 12:23:08 -04:00
Ryan Emerle
52d08e2cf0
Update build and release scripts 2021-10-27 14:09:40 -04:00
Ryan Emerle
61286c685a
Fix perms 2021-10-27 13:44:55 -04:00
Ryan Emerle
5e9b794d8d
Fix permissions 2021-10-27 13:43:57 -04:00
Emerle, Ryan
b143e975a7
Updates
- Move quickstart from `utils` to `quickstart`
- Update quickstart script to add more container manipulation
- Move API functional tests back under `modules/api`
- Move build-related scripts to `build/` directory
- Add quickstart containers that can run the local version of the code
2021-10-27 13:43:21 -04:00
Emerle, Ryan
5fe33eee22
Update docs
- Fix broken links
- Fix formatting
- Add Makefile for running via docker
- Move README.md from `modules/docs/src/main/mdoc` to `modules/docs` to be consistent with `modules/portal`
2021-10-21 14:21:37 -04:00
Emerle, Ryan
9ce466aa0c
Fix microsite broken dependencies and update docs 2021-10-21 11:44:53 -04:00
Ryan Emerle
3e5c179af3
Update permissions 2021-10-20 09:27:40 -04:00
Emerle, Ryan
a075c3c35e Updates
- Move away from using multiple images for "quickstart" and instead use a single "integration" image which provides all of the dependencies

- Update `docker-up-vinyldns.sh` to support the new `integration` image
- Update `remove-vinyl-containers.sh` to more cleanly.. clean up
- Update `verify.sh` to more reliably run `sbt` targets
- Update `build/docker/api/application.conf` to allow for overrides and default to the `vinyldns-integration` image
- Update `build/docker/portal/application.conf` to allow overrides and use `vinyldns-integration` image
  - Update `build/docker/portal/Dockerfile` to use `vinyldns/build:base-build-portal` to reduce need to download dependencies over and over
- Update `api/assembly` sbt target to output to `assembly` rather than some deeply nested folder in `**/target`
- Update documentation to reflect changes

- Move `docker/` directory to `quickstart/` to reduce confusion with the `build/docker` directory
- Move `bin/` to `utils/` since the files are binaries

- Add `.dockerignore` to root
2021-10-20 09:07:19 -04:00
Emerle, Ryan
07b683cbd0 Updates
- Remove old, unused scripts in `bin/`
- Remove old images from release
  - `test` and `test-bind` are no longer necessary. Test images are in a different repo now
- Remove Docker image creation from sbt build config - actual `Dockerfile` files are easier to deal with

- Update scripts in `bin/` to utilize new Docker images
- Update documentation for changes
- Update all Docker Compose and configuration to use exposed ports on the `integration` image (19001, 19002, etc) both inside the container and outside to make testing more consistent irrespective of method
- Update FlywayDB dependency to v8 to fix a weird logging bug that showed up during integration testing. See: https://github.com/flyway/flyway/issues/2270

- Add `test/api/integration` Docker container definition to be used for any integration testing

- Move `module/api/functional_test` to `test/api/functional` to centralize the "integration-type" external tests and testing utilities

- Move functional testing and integration image to the `test/` folder off of the root to reduce confusion with `bin/` and `docker/`
2021-10-15 15:06:04 -04:00
Emerle, Ryan
0a1b533192 WIP - Functional Test Updates
- Update `dnsjava` library
- Add support for H2 database
- Update functional tests to support parallel runs
- Remove the ability to specify number of processes for functional tests - always 4 now
- Add `Makefile` and `Dockerfile` in `functional_test` to make it easier to run tests without spinning up multiple containers
2021-10-08 15:52:09 -04:00
Emerle, Ryan
0b3824ad6c WIP - Functional Test Updates
- Add custom network to `docker-compose-func-test.yml` for deterministic IP addresses
- Update tests to remove hard-coded zone names
- Fix various issues with cleanup
2021-09-29 14:07:57 -04:00
Ryan Emerle
2b65d11af4 Update file permissions 2021-09-28 12:46:07 -04:00
Emerle, Ryan
731e2bc873 WIP - Functional Test Updates
- Update tests to Python 3.x
- Setup partitions to allow for parallel testing
  - Partition bind zones
  - Update `docker/api/docker.conf` to include partitioned zones
- Replace AWS request signer with upgraded `boto3` signer
- Replace launcher script with one that instantiates the virtualenv
- Add `--enable-safety_check` to check for modifications to zone data
- Add `--resolver-ip` to allow for specification of a different resolver for the tests versus what gets sent to the API
  - This is helpful when the tests are not running in the same network as the API
  - Ex: `./run.sh --dns-ip=172.19.0.4 --resolver-ip=127.0.0.1:19001` where
2021-09-28 12:32:51 -04:00
Ryan Emerle
c7f4c16d21
Merge pull request #1046 from Aravindh-Raju/aravindhr/improve-messages
Improve messages
2021-09-08 07:50:13 -04:00
Aravindh R
eff3ba6bac
Merge branch 'vinyldns:master' into aravindhr/improve-messages 2021-09-02 15:10:08 +05:30
Ryan Emerle
d0695ba9e7 Update issue templates 2021-09-01 09:33:08 -04:00
Aravindh R
ce4095ca0c
Update Messages.scala 2021-08-30 16:58:49 +05:30
Aravindh R
c9d30a5082 Update messages 2021-08-30 16:49:05 +05:30
Aravindh R
c78441d6a3 Update messages 2021-08-30 14:46:53 +05:30
Aravindh R
b2fdde5a55
Create Messages.scala 2021-08-27 17:38:58 +05:30
Ryan Emerle
2a1dcb3793
Update README.md
- Remove ROADMAP
2021-08-12 10:58:58 -04:00
Ryan Emerle
be6424caec
Removing ROADMAP
This is severely outdated and does not reflect the current direction of VinylDNS
2021-08-12 10:58:31 -04:00
Ryan Emerle
ec022d0087
Update AUTHORS.md
- Remove redundant maintainer list (found in README.md)
- Add listed tool maintainers to contributors for continued attribution
2021-08-12 10:54:53 -04:00
Ryan Emerle
e117cd4e91
Update Maintainers 2021-08-12 10:51:14 -04:00
Ryan Emerle
1269ad75bf
Update codecov_review.yml 2021-05-20 10:57:24 -04:00
Ryan Emerle
ce43cddecc
Update and rename manual.yml to codecov_review.yml 2021-05-20 10:55:47 -04:00
Ryan Emerle
8641b4a10d
Create manual.yml 2021-05-20 10:48:57 -04:00
Ryan Emerle
4e58657367
Update dnsjava dependency to 2.1.8 (#1041)
Fixes #1040
v0.9.10
2021-04-30 11:48:09 -04:00
Ryan Emerle
bbeb5eb480
Update version to vNext
- Set version to v0.9.10
2021-04-30 11:40:40 -04:00
Ryan Emerle
1e0703908c
Update version for v0.9.9 release (#1037) v0.9.9 2021-03-30 15:34:40 -04:00
Paul Cleary
666d20f514
Drop warning for dotted hosts on valid records (#1036)
Fixes #1034 

Changes in this pull request:
- Update record view for managing records to _not_ display a warning next to records that are valid dotted hosts.
- Update the prepare portal script to do a force (needed for clean machine)
- Add queue coordinates for starting up the api locally using `reStart` - the coordinates were removed from `reference.conf` in a prior PR that looks to have broken starting up using `reStart` locally
- Added a unit test to double check we allow dotted TXT records in the API
2021-03-04 07:58:14 -05:00
Ryan Emerle
7598615cc2
Update maintainers 2021-02-15 09:53:58 -05:00
Ryan Emerle
8fbe82b6e3
Update maintainers 2021-02-15 09:53:31 -05:00
Ryan Emerle
e2cbf2eb0e
Update maintainers 2021-02-15 09:52:14 -05:00
Paul Cleary
47e8f9cd25
Add optional tsig usage for new dns backends (#1032)
It is not always desirable to use a TSIG key for interacting with DNS backends.  This PR makes use of a TSIG key optional.  A new `tsig-usage` configuration parameter is added for DNS backends to allow one to determine how/if TSIG keys are applied.  Note: due to the nature of the configuration, the user must still specify SOME value for the key information; however, the new `tsig-usage` config parameter can choose when or if to apply it.  The values are:

- `always` - always use the 
- `never` - never use the tsig key for either update OR transfers
- `transfer` - use the tsig key for TRANSFER only, updates will not use any keys
- `update` - use the tsig key for UPDATES only, transfers will not use any keys

**Note: this does not yet apply to the UI or the API, changes there will be a future PR**
v0.9.9-M1
2020-12-04 09:03:22 -05:00
Paul Cleary
6a492df8d7
Make tenant id optional (#1031)
Tenant id is not uniformly used across all OIDC providers (such as keycloak).

Make tenant id in configuration and the corresponding OIDC flow check optional for the time being.  

Need to overhaul the OIDC portal code which is well underway but not ready yet, so this is a temporary workaround.
2020-11-16 19:42:01 -05:00
Paul Cleary
77a32bf837
Updating images with new SVG (#1030) v0.9.8 2020-11-11 08:35:54 -05:00
Paul Cleary
25acdb13c7
Burn dynamo burn (#1025)
Fixes #971 

Changes in this pull request:
- Remove the module
- Update `build.sbt`
- Update docs
- Update docker things
- Update configs everywhere
2020-10-23 17:26:52 -04:00
Paul Cleary
aeb5b8310c
Added key algorithm support (#1011)
Fixes #964 

- Updated the `ZoneConnection` model to allow specifying the key algorithm.
- Added an `Algorithm` to the protobuf file, defaults to HMAC-MD5
- Updated JSON serialization to serdes the algorithm
- Updated the Portal to allow the user to specify the algorithm when connecting to a zone or managing a zone

Supported algorithms are:

```
  case object HMAC_MD5 extends Algorithm("HMAC-MD5.SIG-ALG.REG.INT")
  case object HMAC_SHA1 extends Algorithm("hmac-sha1.")
  case object HMAC_SHA224 extends Algorithm("hmac-sha224.")
  case object HMAC_SHA256 extends Algorithm("hmac-sha256")
  case object HMAC_SHA384 extends Algorithm("hmac-sha384.")
  case object HMAC_SHA512 extends Algorithm("hmac-sha512.")
```

**Note: needs some tests**
2020-10-23 15:23:01 -04:00
Paul Cleary
b9a56bc123
[ci skip] Fixing menu for docs (#1024)
Had some side bar issues, the `menu.yml` was inadvertantly not merge because of .gitignore
2020-10-23 14:12:38 -04:00
Paul Cleary
97e80e54e8
Update microsite, move to mdoc (#1023)
We used to rely on `tut` for docs, however it is deprecated to be replaced with mdoc.

Moved to an `mdoc` folder structure and updated all of the links (what a pain).
2020-10-23 08:22:26 -04:00
Paul Cleary
e4264fb34c
Overhaul config (#1022)
This is a rather big change.  There are a few significant issues with the way that the API config is presently loaded:

1. We use effectively global variables throughout the system, which is a bad practice in general
2. We have inconsistent loading of configuration values, some used at boot up, some used elsewhere

In addition, we get sporadic build failures due to how these "global config" values are loaded, based on timing and parallelism that are impossible to reproduce.

This PR addresses these issues:

1. Create a `VinylDNSConfig` that loads all configuration in one place
2. Create custom `ConfigReader` implementations that read config values (ideally we would have used pureconfig from the start to automatically read sane config values but here we are)
3. Segment config into different case classes.  The groupings are not totally arbitrary, but I did my best at logical groupings of settings
4. Inject configuration elements (either via Class constructors or function arguments) at the appropriate time.

Functionally, nothing has changed, other than putting some standards around config loading.

May fix #1010
2020-10-22 13:15:46 -04:00
slandry90
ae33147566
R53 soa fix (#1019)
Fixes #1018 .

Also fixes a configuration merge bug now that access-key and secret-key are optional fields, this is non breaking since no one has x/x for their key/secret
2020-10-17 10:47:28 -04:00
Paul Cleary
bf3122bdd5
Fix route53 issue with merge fqdn (#1017)
Addresses #1012

Was able to get a "real" public hosted zone connected.  The `Fqdn.merge` was not working properly when merging record name and zone names when they matched.

Added a bunch of unit tests along with the fix.

This was tested against a "real" public hosted zone.  Verified connect, load zone, add record, delete record.
2020-10-16 13:54:47 -04:00
Amey Bhide
47d4d80801
Refactor SQS creds provider (#1014)
Tickets: https://github.com/vinyldns/vinyldns/issues/1008
Fixes: #1008

Add DefaultCredentialsProvider to SQS queue provider
2020-10-16 11:00:34 -04:00
Paul Cleary
10a806b45b
Remove lazy from config, update to sbt 1.4.0 (#1016)
Addresses #1010 

Attempt to fix sporadic build failures not resolving reference.conf
2020-10-16 07:56:29 -04:00