GitLocker: The Coding Marketplace

Description:

cyperfagentmanager 0.0.13

cyperf-agent-manager
A simple python script that can ssh into multiple cyperf agents and run some pre-defined commands

Table of Contents

Installation
License
CLI
Password Override
Module

Installation
pip install cyperf-agent-manager

If pip command is not found on your system then use the following commands to install pip.
$ wget https://bootstrap.pypa.io/get-pip.py
$ python get-pip.py

If python command is also not found then please look for python3 command. Otherwise install python3.
License
cyperf-agent-manager is distributed under the terms of the MIT license.
CLI
This package installs a command called cyperf-agent-manager that is a very thin wrapper over cyperf_agent_manager package. This top level commands has many subcommands that can be used to execute different operations on multiple agents at simultaneously.
The command details can be found by running the script with --help option, as shown in the following blocks.
[PROMPT]:~$ cyperf-agent-manager --help
Usage: cyperf-agent-manager [OPTIONS] COMMAND [ARGS]...

Options:
--help Show this message and exit.

Commands:
install-build
reload
set-controller
set-test-interface

Installing an agent build on multiple agents
[PROMPT]:~$ cyperf-agent-manager install-build --help
Usage: cyperf-agent-manager install-build [OPTIONS]

Options:
--agent-ips NETWORK ADDRESS LIST
One or more agent names (IP addresses or
hostnames). Use quotation marks (`'` or `"`)
for whitespace (` `) separated values. Other
valid separators are `,`, `;` and `:`.
[required]
--username TEXT A common username for all the agents.
[default: cyperf]
--override-password This along with --password option should be
used for non default password.
--password TEXT A common password for all the agents.
--key-file FILE A common key file for opening ssh
connections to all the agents.
--debian-file-path FILE Path to the .deb file to be installed.
[required]
--help Show this message and exit.

Example:
========

[PROMPT]:~$ cyperf-agent-manager install-build --agent-ips '10.36.75.69 10.36.75.70' --debian-file-path ./tiger_x86_64_ixos-8.50_ixstack-raw_release_1.0.3.575.deb
>> Connectiong to agent 10.36.75.69
>> Tranferring file ./tiger_x86_64_ixos-8.50_ixstack-raw_release_1.0.3.575.deb to ~/tiger_x86_64_ixos-8.50_ixstack-raw_release_1.0.3.575.deb
>> Connectiong to agent 10.36.75.70
>> Tranferring file ./tiger_x86_64_ixos-8.50_ixstack-raw_release_1.0.3.575.deb to ~/tiger_x86_64_ixos-8.50_ixstack-raw_release_1.0.3.575.deb
>> Connectiong to agent 10.36.75.69
>> Executing command sudo -S -p '' apt install -y ~/tiger_x86_64_ixos-8.50_ixstack-raw_release_1.0.3.575.deb
Reading package lists...
Building dependency tree...
Reading state information...
The following NEW packages will be installed:
tiger-x86-64-ixos-8.50-ixstack-raw-release-1.0.3.575
0 upgraded, 1 newly installed, 0 to remove and 2 not upgraded.
Need to get 0 B/62.0 MB of archives.
After this operation, 0 B of additional disk space will be used.
Get:1 /home/cyperf/tiger_x86_64_ixos-8.50_ixstack-raw_release_1.0.3.575.deb tiger-x86-64-ixos-8.50-ixstack-raw-release-1.0.3.575 all 1.0.3.575 [62.0 MB]
Selecting previously unselected package tiger-x86-64-ixos-8.50-ixstack-raw-release-1.0.3.575.
(Reading database ... 69919 files and directories currently installed.)
Preparing to unpack .../tiger_x86_64_ixos-8.50_ixstack-raw_release_1.0.3.575.deb ...
Unpacking tiger-x86-64-ixos-8.50-ixstack-raw-release-1.0.3.575 (1.0.3.575) ...
Setting up tiger-x86-64-ixos-8.50-ixstack-raw-release-1.0.3.575 (1.0.3.575) ...
Creating symbolic links
Installing portmanager
Stopping existing portmanager service.
Creating symbolic links
Removing the existing cyperfagentcli auto-completion script
Ensuring /etc/bash_completion.d/ directory is present in the system

Reusing following configurations from existing configuration
Broker URL: nats://10.36.75.126:30422
Management Interface: ens160
Test Interface: [auto]
Hooks:
pre_diagnostic_collection: /opt/keysight/tiger/active/bin/utilities/01_ipsec_concatenate_key_logs
Tags: []

Removing portmanager database
Installing portmanager service
Installing agent-update service
Starting portmanager service
Setting stack type ixstack-raw

Parsing config JSON file
schemaFileUri = file:///opt/keysight/tiger/active/bin/portmanager/portmanager-config.json.schema.json configFileUri = file:///etc/portmanager/portmanager-config.json
Restarting portmanager
Stack type set to: ixstack-raw

Portmanager service restarted.

Starting portmanager service
Installing QAT Engine

****Installing QAT Engine****>

***QAT Engine Installation Complete***>

***installer operation status is Success***>

/

Hook pre_diagnostic_collection is set to /opt/keysight/tiger/active/bin/utilities/01_ipsec_concatenate_key_logs.

Portmanager service restarted.

>> Connectiong to agent 10.36.75.70
>> Executing command sudo -S -p '' apt install -y ~/tiger_x86_64_ixos-8.50_ixstack-raw_release_1.0.3.575.deb
Reading package lists...
Building dependency tree...
Reading state information...
The following NEW packages will be installed:
tiger-x86-64-ixos-8.50-ixstack-raw-release-1.0.3.575
0 upgraded, 1 newly installed, 0 to remove and 2 not upgraded.
Need to get 0 B/62.0 MB of archives.
After this operation, 0 B of additional disk space will be used.
Get:1 /home/cyperf/tiger_x86_64_ixos-8.50_ixstack-raw_release_1.0.3.575.deb tiger-x86-64-ixos-8.50-ixstack-raw-release-1.0.3.575 all 1.0.3.575 [62.0 MB]
Selecting previously unselected package tiger-x86-64-ixos-8.50-ixstack-raw-release-1.0.3.575.
(Reading database ... 72923 files and directories currently installed.)
Preparing to unpack .../tiger_x86_64_ixos-8.50_ixstack-raw_release_1.0.3.575.deb ...
Unpacking tiger-x86-64-ixos-8.50-ixstack-raw-release-1.0.3.575 (1.0.3.575) ...
Setting up tiger-x86-64-ixos-8.50-ixstack-raw-release-1.0.3.575 (1.0.3.575) ...
Creating symbolic links
Installing portmanager
Stopping existing portmanager service.
Creating symbolic links
Removing the existing cyperfagentcli auto-completion script
Ensuring /etc/bash_completion.d/ directory is present in the system

Reusing following configurations from existing configuration
Broker URL: nats://10.36.75.126:30422
Management Interface: ens160
Test Interface: [auto]
Hooks:
pre_diagnostic_collection: /opt/keysight/tiger/active/bin/utilities/01_ipsec_concatenate_key_logs
Tags: []

Removing portmanager database
Installing portmanager service
Installing agent-update service
Starting portmanager service
Setting stack type ixstack-raw

Parsing config JSON file
schemaFileUri = file:///opt/keysight/tiger/active/bin/portmanager/portmanager-config.json.schema.json configFileUri = file:///etc/portmanager/portmanager-config.json
Restarting portmanager
Stack type set to: ixstack-raw

Portmanager service restarted.

Starting portmanager service
Installing QAT Engine

****Installing QAT Engine****>

***QAT Engine Installation Complete***>

***installer operation status is Success***>

/

Hook pre_diagnostic_collection is set to /opt/keysight/tiger/active/bin/utilities/01_ipsec_concatenate_key_logs.

Portmanager service restarted.

Setting controller IP for multiple agents
[PROMPT]:~$ cyperf-agent-manager set-controller --help
Usage: cyperf-agent-manager set-controller [OPTIONS]

Options:
--agent-ips NETWORK ADDRESS LIST
One or more agent names (IP addresses or
hostnames). Use quotation marks (`'` or `"`)
for whitespace (` `) separated values. Other
valid separators are `,`, `;` and `:`.
[required]
--username TEXT A common username for all the agents.
[default: cyperf]
--override-password This along with --password option should be
used for non default password.
--password TEXT A common password for all the agents.
--key-file FILE A common key file for opening ssh
connections to all the agents.
--controller-ip NETWORK ADDRESS
The IP/Hostname of the CyPerf controller.
[required]
--help Show this message and exit.

Example:
========

[PROMPT]:~$ cyperf-agent-manager set-controller --controller-ip 10.36.75.126 --agent-ips '10.36.75.69 10.36.75.70'
>> Connectiong to agent 10.36.75.69
>> Executing command cyperfagent controller set 10.36.75.126

Controller is set successfully.

Current Configurations
Controller: 10.36.75.126:30422
Management Interface: ens160
Test Interface: ens192

Please make sure that the URL and interfaces are set correctly for the tests to run.

Portmanager service restarted.

Connecting....Connected

>> Connectiong to agent 10.36.75.70
>> Executing command cyperfagent controller set 10.36.75.126

Controller is set successfully.

Current Configurations
Controller: 10.36.75.126:30422
Management Interface: ens160
Test Interface: ens192

Please make sure that the URL and interfaces are set correctly for the tests to run.

Portmanager service restarted.

Connecting....Connected

Reloading configuration for multiple agents
[PROMPT]:~$ cyperf-agent-manager reload --help
Usage: cyperf-agent-manager reload [OPTIONS]

Options:
--agent-ips NETWORK ADDRESS LIST
One or more agent names (IP addresses or
hostnames). Use quotation marks (`'` or `"`)
for whitespace (` `) separated values. Other
valid separators are `,`, `;` and `:`.
[required]
--username TEXT A common username for all the agents.
[default: cyperf]
--override-password This along with --password option should be
used for non default password.
--password TEXT A common password for all the agents.
--key-file FILE A common key file for opening ssh
connections to all the agents.
--help Show this message and exit.

Example:
========

[PROMPT]:~$ cyperf-agent-manager reload --agent-ips '10.36.75.69 10.36.75.70'
>> Connectiong to agent 10.36.75.69
>> Executing command cyperfagent configuration reload

Current Configurations
Controller: 10.36.75.126:30422
Management Interface: ens160
Test Interface: ens192

Please make sure that the URL and interfaces are set correctly for the tests to run.

Portmanager service restarted.

Connecting.....Connected

>> Connectiong to agent 10.36.75.70
>> Executing command cyperfagent configuration reload

Current Configurations
Controller: 10.36.75.126:30422
Management Interface: ens160
Test Interface: ens192

Please make sure that the URL and interfaces are set correctly for the tests to run.

Portmanager service restarted.

Connecting....Connected

Setting test interface for multiple agents
[PROMPT]:~$ cyperf-agent-manager set-test-interface --help
Usage: cyperf-agent-manager set-test-interface [OPTIONS]

Options:
--agent-ips NETWORK ADDRESS LIST
One or more agent names (IP addresses or
hostnames). Use quotation marks (`'` or `"`)
for whitespace (` `) separated values. Other
valid separators are `,`, `;` and `:`.
[required]
--username TEXT A common username for all the agents.
[default: cyperf]
--override-password This along with --password option should be
used for non default password.
--password TEXT A common password for all the agents.
--key-file FILE A common key file for opening ssh
connections to all the agents.
--test-interface TEXT The name of the interface on the agents
which will be used for test traffic.
[required]
--help Show this message and exit.

Example:
========

[PROMPT]:~$ cyperf-agent-manager set-test-interface --agent-ips '10.36.75.69 10.36.75.70' --test-interface auto
>> Connectiong to agent 10.36.75.69
>> Executing command cyperfagent interface test set auto

Test Interface is set successfully.

Current Configurations
Controller: 10.36.75.126:30422
Management Interface: ens160
Test Interface: auto (Auto-detected interface is ens192)

Please make sure that the URL and interfaces are set correctly for the tests to run.
Use the following commands to explicitly set the Management and Test interfaces:
cyperfagent interface management set <Management interface name>
cyperfagent interface test set <Test interface name>

Portmanager service restarted.

>> Connectiong to agent 10.36.75.70
>> Executing command cyperfagent interface test set auto

Test Interface is set successfully.

Current Configurations
Controller: 10.36.75.126:30422
Management Interface: ens160
Test Interface: auto (Auto-detected interface is ens192)

Please make sure that the URL and interfaces are set correctly for the tests to run.
Use the following commands to explicitly set the Management and Test interfaces:
cyperfagent interface management set <Management interface name>
cyperfagent interface test set <Test interface name>

Portmanager service restarted.

Password Override
Even though CyPerf agents are deployed from official machice images provided CyPerf team, CyPerf can also installed on arbitrary machines. All CyPerf machine images come with a default password. cyperf-agent-manager by default tries to connect with that default password. Obviously the default password won't work for arbitrary machines. In those cases the password has to be overriden. The options --override-password and --password are there for that purpose only but using --password directly in CLI is unsafe. In that case the actual password will be visible in plain text. A better option is to use only the --override-password option in CLI and then a password prompt will come up. The user will be able to type the password in an invisible way. Please see the example below.
If a key file is provided using --key-file option then cyperf-agent-manager will try to open a connection with each agent using the key file first. If authentication fails with the key file then it will try the password.
Example
[PROMPT]:$ cyperf-agent-manager reload --agent-ips '10.36.75.69 10.36.75.70' --override-password
Password [cyperf]:
Repeat for confirmation:
>> Connectiong to agent 10.36.75.69
>> Executing command cyperfagent configuration reload

Current Configurations
Controller: 10.36.75.126:30422
Management Interface: ens160
Test Interface: auto (Auto-detected interface is ens192)

Please make sure that the URL and interfaces are set correctly for the tests to run.
Use the following commands to explicitly set the Management and Test interfaces:
cyperfagent interface management set <Management interface name>
cyperfagent interface test set <Test interface name>

Portmanager service restarted.

Connecting.....Connected

>> Connectiong to agent 10.36.75.70
>> Executing command cyperfagent configuration reload

Current Configurations
Controller: 10.36.75.126:30422
Management Interface: ens160
Test Interface: auto (Auto-detected interface is ens192)

Please make sure that the URL and interfaces are set correctly for the tests to run.
Use the following commands to explicitly set the Management and Test interfaces:
cyperfagent interface management set <Management interface name>
cyperfagent interface test set <Test interface name>

Portmanager service restarted.

Connecting....Connected

Module
The python module installed by this package in cyperf_agent_manager. This can be used from a custom python script. Here is a smaple code that uses the cyperf_agent_manager module.
import cyperf_agent_manager.agent_manager as caMgr

agentIPs = [ '192.168.0.1', '192.168.0.2' ]
controllerIP = '192.168.100.1'
testIface = 'ens192'
debFile = './tiger_x86_64_ixos-8.50_ixstack-raw_release_1.0.3.575.deb'

agentMgr = caMgr.CyPerfAgentManager(agentIPs)

agentMgr.InstallBuild (debFile)
agentMgr.ControllerSet (controllerIP)
agentMgr.Reload ()
agentMgr.SetTestInterface (testIface)