71 Commits

Author SHA1 Message Date
Lee Goolsbee
677f2a85ca ITPLT-3650 drop support for Amazon Linux 2 2024-04-29 12:10:12 -05:00
Geoff Jacobs
fa61970756 reverting previous changes. issue turned out to be the wrong version of python on a node 2023-08-11 13:40:08 +10:00
Geoff Jacobs
7300302287 changing where we set the ansible_python_interpreter so that it can be overriden at a task level 2023-08-11 09:10:07 +10:00
Lee Goolsbee
293dddcd2d ensure pipenv uses python 3.11 on AL2023 2023-06-23 11:19:47 -05:00
Lee Goolsbee
6151f01534 Merged in al2022 (pull request #187)
Add support for Amazon Linux 2022

* first pass at basic AL2022 support

* unpin git version on AL2022

* resolve a few package issues/discrepancies

* fix non-Amazon distro support

* fix missing nfs.service symlink on AL2022

* remove Ubuntu/Debian install task from aws_common (no existing ubuntu dependency tasks)

* add amazonlinux:2022 to list of images for testing via molecule

* install amazon-cloudwatch-agent from package sources instead of direct RPM on AL2022; add workaround for missing group

* fix typo in task name

* add mising amazonlinux:2022 test for product_install role

* al2022 -> al2023

* al2023 ships with rpm-installed versions of setuptools and distlib that aren't removable and older than what pipenv requires; use py3.11 instead


Approved-by: Vadym Kovalskiy
Approved-by: Eugene Ivantsov
Approved-by: Yurii Kuzan
2023-05-17 17:11:12 +00:00
Lee Goolsbee
45dbd4839b drop system lxml; install with pipenv instead 2022-09-27 09:45:04 -05:00
Lee Goolsbee
8c745195c6 go with psycopg2-binary instead of building psycopg2 2022-09-15 11:08:02 -05:00
Lee Goolsbee
a560258945 development doc updates; drop python2 dependency for debian/ubuntu hosts (only needed for AL2/yum) 2022-09-09 17:09:27 -05:00
Lee Goolsbee
57c2cad83f fix some line-endings, add dependencies, allow python other than 3.8 2022-09-09 17:09:27 -05:00
Lee Goolsbee
797da718d1 add a retry loop (mostly for parallel pipelines tests where this can generate too many requests errors) 2022-09-09 17:09:27 -05:00
Lee Goolsbee
e1f5521652 upgrade dependencies 2022-09-07 18:56:05 -05:00
Yevhen Karnaukhov
f20f0c2de1 DCD-1387 Confluence FileNotFoundError fixing 2022-03-10 13:01:25 +01:00
Lee Goolsbee
3ea9a0dcca ITPLT-637 use IMDSv2 2022-02-25 10:39:18 -06:00
Steve Smith
c0e90b81de DCD-1387: The latest pipenv broke under Amazon Linux, so pin to previous. 2021-11-08 12:11:38 +11:00
Lee Goolsbee
2b1c0de1a2 install lxml to system python via yum package instead of root user pip install 2021-02-26 17:55:20 -06:00
Dylan Rathbone
4bda130d5f Remove python2 pip for Debian installs 2020-11-03 10:24:02 +10:00
Dylan Rathbone
ccee6e4d8c Remove python2 pip for Debian installs 2020-11-03 10:21:13 +10:00
Dylan Rathbone
301f44cbef Add python2 pip for Debian installs 2020-11-03 09:16:49 +10:00
Dylan Rathbone
e2e4ce4ba6 Add python2 pip for Debian installs 2020-11-03 08:37:21 +10:00
Dylan Rathbone
3c2b000db5 Install lxml into system python env 2020-11-02 16:40:52 +10:00
Brett Meehan
6404fca50f ITOPSENG-529-bump-pip-timeout 2020-03-25 12:01:42 +11:00
Ben Partridge
8ba60b6586 DCD-880: Add option to override ansible playbook params at invocation 2020-01-03 15:56:06 +11:00
Ben Partridge
45e357fdd2 DCD-800: pipe stderr to iconv as well as stdout 2019-11-29 10:55:20 +11:00
Ben Partridge
5490651e9e DCD-800: Use iconv to strip non-ascii characters 2019-11-29 10:32:41 +11:00
Ben Partridge
32bfef040c Force no spinner when running pipenv sync 2019-11-28 16:41:34 +11:00
Ben Partridge
843f1c26e7 Revert "Redirect all logs to dev/null when running pipenv sync"
This reverts commit 14465e259f.
2019-11-28 16:30:35 +11:00
Ben Partridge
14465e259f Redirect all logs to dev/null when running pipenv sync 2019-11-28 16:23:48 +11:00
Ben Partridge
d7fdb4c4c2 Suppress emoji and standard output when calling pipenv as it outputs
characters in non-ascii which causes errors in cloud-init
2019-11-28 15:29:44 +11:00
Steve Smith
72659de9ad DCD-686: Install Postgres only if restoration is required. 2019-10-10 09:30:45 +11:00
Steve Smith
5996a176d5 DCD-686: We need postgres installed for client utils. 2019-10-09 13:25:32 +11:00
Steve Smith
cb691d2556 DCD-686: We still need some python2 packages. 2019-10-09 13:14:04 +11:00
Steve Smith
07e97ba35e DCD-686: Fix some issues with packages on Amazon Linux. 2019-10-09 13:00:53 +11:00
Steve Smith
87ac31ea3a DCD-686: Move back to pipenv-based Ansible installation to work around bugs (again). 2019-10-04 13:55:37 +10:00
Steve Smith
60b823cd02 DCD-686: Try with python3. 2019-10-04 12:10:07 +10:00
Steve Smith
ba25ab8f73 DCD-686: Update to Debian Buster for better compability with Amazon Linux 2. 2019-10-04 11:57:54 +10:00
Steve Smith
5e85f71ae8 DCD-686: Update pipelines config. 2019-10-04 11:39:43 +10:00
Steve Smith
f5ebeaedb0 DCD-686: Amazon Linux 2 has updated its Ansible packages so we can remove pipenv from the installation phase. 2019-10-03 14:23:05 +10:00
Steve Smith
46adc9af3f DCD-686: Move to Python 3.7 and update packages to support AWS operations. 2019-10-03 13:29:21 +10:00
Steve Smith
8888b8c183 DCD-662: Update custom params var name to match QuickStarts. 2019-09-23 09:08:54 +10:00
Steve Smith
84e37e7df9 DCD-658: Rename extra parameter variable for clarity. 2019-09-17 08:48:30 +10:00
Steve Smith
c687f8ab76 DCD-658: Break up commandline for clarity. 2019-09-16 11:56:22 +10:00
Steve Smith
2299596613 DCD-658: Add injection of custom parameters to the ansible commandline. 2019-09-16 11:53:37 +10:00
Varun Arbatti
522706467e Merged in DCD-621-parallelize-builds (pull request #20)
DCD-621 parallelize builds

* DCD-621: Parallelizes tests ny invoking the parralelize script

* DCD-621: Removes leading / to start jira command in product_startup role

* DCD-621: Runs a scenario by name instead of using the all parameter

* DCD-621: A better find all scenarios function to ensure we look at relevant molecule scenarios. Better logging too

* DCD-510: Parallelizes tests further, running in 26 batches on 1 each. The pipeline file is now generated using Jinja

* DCD-510: Adds a pre check stage to verify if number of batches match actual number of scenarios. This test will fail (deliberately)

* DCD-510: Adds a pre check stage to verify if number of batches match actual number of scenarios. Fixes 'test' failure

* DCD-590: Adds note to development.md on how to generate a pipeline file. Adds a makefile and updates a few script commands

* DCD-590: Better documentation in development README document. Updates YML with instructions on how to fix issues with the prevalidation stage

Approved-by: Steve Smith <ssmith@atlassian.com>
Approved-by: Ben Partridge <bpartridge@atlassian.com>
2019-08-30 06:22:53 +00:00
Varun Arbatti
90cd3f5f98 DCD-621: Cleans up comments & extracts batch number to a variable 2019-08-29 16:49:25 +10:00
Varun Arbatti
8cf01382af DCD-621: Changes pipelines to run scenarios in parallel. (9 batches of 3 scenarios each) 2019-08-29 16:12:14 +10:00
Azra Sulthana
2c25fb2020 added /usr/local/bin to PATH 2019-07-17 13:43:31 +05:30
Steve Smith
3eb5af4cd2 DCD-386: Typo 2019-06-14 10:23:40 +10:00
Steve Smith
b12d204267 DCD-386: Use noconfirm for package installation. 2019-06-13 15:58:25 +10:00
Steve Smith
e1dab14a7f DCD-386: Cleanups and clarifications. 2019-06-13 15:30:56 +10:00
Steve Smith
8925cd5af9 DCD-386: Use sync rather than install to use locked package versions. 2019-06-13 15:24:31 +10:00