summaryrefslogtreecommitdiffstats
Commit message (Collapse)AuthorAgeFilesLines
* live: improve part not found log in image_createAlejandro Sirgo Rica2024-10-081-1/+1
| | | | Report the partition number of the missing partition.
* src: fix cache mount in new ogLiveAlejandro Sirgo Rica2024-10-082-20/+11
| | | | | | | Mount cache in image_create() image_restore() and cache_fetch(). Remove init_cache() and ensure /opt/opengnsys/images/ exists within the cache mountpoint if it does not exists in cache_mount().
* live: remove useless check in compute_md5OpenGnSys Support Team2024-10-051-2/+0
| | | | this never returns -1 on error, an exception is rised instead
* src: consolidate compute_md5 functionsAlejandro Sirgo Rica2024-10-023-29/+20
| | | | | | | | | | Add compute_md5 function in src/utils/fs.py Remove identical md5 functions from src/live/ogOperations.py and src/utils/tiptorrent.py Move error checks from ogOperations.py into compute_md5 function in src/utils/fs.py
* src: check if the system is hibernated before /image/createAlejandro Sirgo Rica2024-10-023-4/+24
| | | | | | | Mount the system partition in readonly mode and check for the hiberfil.sys file if the target system is a Windows. Fail the image creation process if the target system is hibernated.
* ogclient: add --server-ip flag to override the server's IPAlejandro Sirgo Rica2024-10-021-0/+5
| | | | Add CLI flag to override the server IP defined in the config file.
* live: refactor poweroff and rebootOpenGnSys Support Team2024-10-011-14/+40
| | | | | | - enable WoL - check for poweroff and reboot before checking for busybox. - call new shutdown method
* tiptorrent: missing f-string in errorOpenGnSys Support Team2024-10-011-1/+1
| | | | tip_client_get() needs f-string to display error
* live: fix EBUSY error in newer kernels with mkfsOpenGnSys Support Team2024-10-011-19/+21
| | | | | | | | | | | | python-libfdisk does not close file descriptor to /dev/sda after completing partitioning. This results EBUSY errors when formatting partitions with mkfs in newer kernels. Encapsulate code to partition in method so python garbage collection knows ctx objects can be release then close file descritor to /dev/sda. ogRest is not accessible from _partition(), remove check to ogRest.terminated, actually no need to terminate inmediately when formatting is ongoing, better leave things in consistent state when stop command is received.
* live: report correct partition size unit in setup() logAlejandro Sirgo Rica2024-10-011-1/+1
| | | | Log the correct partition size unit. Use MiB instead of MB.
* src: replace DEVICE env variable with get_ethernet_interface()Alejandro Sirgo Rica2024-10-015-8/+76
| | | | | | Use a python function to obtain the main net interface. Detect the first ethernet inferface in use. Stop using the DEVICE environment variable.
* live: remove unused probeOpenGnSys Support Team2024-09-304-37/+1
| | | | unused since ogserver's commit 87be2ce08 #980 Change initial probe to refresh
* live: use busybox otherwise poweroff/reboot commandsOpenGnSys Support Team2024-09-301-4/+4
|
* live: disable browser operations if the binary is missingAlejandro Sirgo Rica2024-09-272-2/+7
| | | | | Add shutils.which checks before every browser operations to skip the subprocess call if the binary is missing.
* src: report used and free partition data in bytesAlejandro Sirgo Rica2024-09-253-18/+23
| | | | | | | | | | | | | | | | | | | | | | | | | | Add "used_size" and "free_size" to the partition data and the cache data. Old response from ogClient for /cache/delete, /cache/fetch and /image/restore: { 'cache': [ {'name': 'windows.img', 'size': 2432370213, checksum: '5d4dcc677bc19f40a647d0002f4ade90'}, {'name': 'linux.img', 'size': 243234534213, checksum: '3eb22f888f88a55ad954f55644e1192e'} ] } New response: { 'cache': { 'used_size': 4520232322423, 'free_size': 48273465287452945, 'images': [ {'name': 'windows.img', 'size': 2432370213, checksum: '5d4dcc677bc19f40a647d0002f4ade90'}, {'name': 'linux.img', 'size': 243234534213, checksum: '3eb22f888f88a55ad954f55644e1192e'} ] } }
* sw_inventory: consolidate os_probe logicAlejandro Sirgo Rica2024-09-252-7/+3
| | | | | | | | Reuse os_probe() function from probe.py and change the fallback case to "unknown" to prevent OS id mismatch in ogserver. The OS id mismatch causes the images to stop being associated with partitions after the /refresh command.
* src: verify the fields of the efibootmgr json in /refreshAlejandro Sirgo Rica2024-09-252-7/+30
| | | | | | | Don't send the efi data in the /refresh payload if efibootmgr is missing any of the json keys. Log the missing keys in case of missing some.
* utils: Add windows_register_c_drive implementationAlejandro Sirgo Rica2024-09-123-9/+92
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Add python implementation of the legacy ogWindowsRegisterPartition function. This function configures the system partition to be considered the new C drive after a Windows image restore. The drive letter configuration is stored in the SYSTEM hive of the windows registry. The node MountedDevices contains all the configuration as key-value pairs. The C drive key \DosDevices\C: contains a different value based on the partitioning type. GPT the value is DMIO:ID: followed by the 16 byte GUID of the partition. Example: DMIO:ID:\xc9\xfc\x1c\x86\x13\x11O\t\xa2\x9c{/\xf1\xdf\xe4) MBR The value is a little endian byte sequence with 2 parts. The first 4 bytes correspond to the disk id. The second part is the byte offset start of the partition in that disk. Example: \xe1\\\x9cP\x00\x00\x10j\x18\x00\x00\x00 If we format the MBR value in a more readable way we get e1 5c 9c 50 00 00 10 6a 18 00 00 00 In this case the disk ID is 509c5ce1. The partition offset is 186a100000. This patch adds the following helper functions to: - get_disk_id_bytes(): to obtain the disk identifier. - get_part_id_bytes(): to obtain a partition identifier as UUID for MBR or DMIO:ID format for GPT. - get_sector_size(): to query the sector size of a specific disk. Read /sys/class/block/{device_name}/queue/hw_sector_size to obtain the value. This is MBR specific. - get_partition_start_offset(): to query the start sector of a specific partition and disk. Use sfdisk with the -J argument to get fdisk data in json format. This is MBR specific.
* live: add boot entries into /refresh payloadAlejandro Sirgo Rica2024-09-101-0/+31
| | | | | | | | | | | | | | | | | | | | | | | | | Add 'efi' key into the refresh payload. The value for that key has the following structure: 'efi': { 'entries': [ { "order": 0, "name": "Boot0000", "active": false, "description": "grub" }, { "order": 1, "name": "Boot0001", "active": true, "description": "UEFI: PXE IP4 Realtek PCIe GBE Family Controller" } ] } If the client is not a EFI system it won't add the 'efi' field. If an entry is not in the boot order it won't have the 'order' field.
* bcd: make recovery modifications optionalv1.3.2-19Alejandro Sirgo Rica2024-09-101-1/+5
| | | | Ignore recovery disable if no Recovery node is found in the BCD.
* live: use correct variable name in restore unicast cachev1.3.2-18OpenGnSys Support Team2024-09-091-1/+1
| | | | | | | | | | | | | | fe40f9c5 ('src: add POST cache/fetch method') broke unicast cache restore. (2024-09-09 10:05:22) ogClient: [ERROR] - name 'image_name' is not defined Traceback (most recent call last): File "/opt/opengnsys/ogClient/src/ogRest.py", line 175, in image_restore payload = ogRest.operations.image_restore(request, ogRest) File "/opt/opengnsys/ogClient/src/live/ogOperations.py", line 520, in image_restore self._restore_image_unicast(repo, name, partdev, cache) File "/opt/opengnsys/ogClient/src/live/ogOperations.py", line 242, in _restore_image_unicast image_path = f'{OG_CACHE_IMAGE_PATH}{image_name}.img' NameError: name 'image_name' is not defined
* live: incorrect indentationv1.3.2-17OpenGnSys Support Team2024-09-031-4/+4
| | | | | f2a2f5307464 ('live: remove file from cache with no checksum file') broke indentation which breaks ogClient.
* live: add disk index bounds checkv1.3.2-16Alejandro Sirgo Rica2024-09-021-4/+10
| | | | | Add disk index bounds checks for setup() and image_create(). Prevent backtrace logging when an invalid disk index is used.
* live: remove file from cache with no checksum fileOpenGnSys Support Team2024-09-021-1/+10
| | | | | Maybe result of a partial download? then, remove it to leave cache in consistent state.
* utils: replace the legacy function ogConfigureFstabAlejandro Sirgo Rica2024-08-303-9/+235
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Implement configure_fstab() as a replacement of ogConfigureFstab. Create src/utils/fstab.py to implement the main fstab configuration functions. Define two fstab helper classes, FstabBuilder and FstabEntry. FstabEntry Represents each line in the fstab file. Has the values: device, mountpoint, fstype, options, dump_code and pass_code. FstabBuilder Contains a list of FstabEntry. Handles loading of a preexisting fstab file and the serialization of multiple FstabEntry into a file. The fstab configuration has 3 main steps: Root partition: - Update the device field with the device where the new system is installed. Swap partition: - Preserve all the swapfile entries in every case. - If the filesystem has a swap partition: update the device field in the first fstab swap entry and remove the rest swap entries pointing to a swap partition. Only one swap partition is supported. Create a new fstab entry if no preexisting swap entry exists. - If the system has no swap partition remove every swap partition entry. EFI partition: - Update the device field of the EFI fstab entry if it exists. Create a new fstab entry if no preexisting EFI entry exists. Add get_filesystem_id to disk.py to obtain the UUID. Define every device field as a UUID. That method is more robust than a plain device path as it works after disks being added or removed.
* postinstall: ignore legacy scripts non-zero return codeOpenGnSys Support Team2024-08-301-54/+47
| | | | | legacy scripts are not reliable, legacy scripts continue processing on errors, warn on errors until they are converted to native code instead.
* src: append .img to log that report image fetchingOpenGnSys Support Team2024-08-292-2/+2
|
* src: use logging.warning()OpenGnSys Support Team2024-08-273-11/+8
| | | | | | | logging.warn() is deprecated since 3.3. And use .error() instead when command is unsupported or client is busy, that should not ever happen.
* utils: bcd: update logging related to BCD updates with MBR partitionOpenGnSys Support Team2024-08-271-1/+1
| | | | | MBR requires manual bcdedit invocation to generalize image before creation. Report via logging that no BCD update occurs.
* live: report that up-to-date image already exists in cachev1.3.2-15OpenGnSys Support Team2024-08-211-0/+1
|
* utils: return False instead of rising exceptionOpenGnSys Support Team2024-08-211-2/+4
| | | | | if image file and checksum are not found in the cache, then report checksum validation has failed so it can proceed to fetch new files from server.
* src: remove call to restoreImageCustom scriptOpenGnSys Support Team2024-08-212-21/+3
| | | | remove call to custom version of legacy script, display warning.
* live: clean files after a failed cache image copyAlejandro Sirgo Rica2024-08-091-0/+7
| | | | Remove image files after a failed image copy operation.
* src: log without backtrace in not implemented functionsAlejandro Sirgo Rica2024-08-093-18/+20
| | | | | | Don't log a backtrace when a not implemented function is called in ogClient. Log a "Function not implemented" message.
* postinstall: remove shell=TrueAlejandro Sirgo Rica2024-08-091-4/+5
| | | | Remove the use of shell=True.
* src: add POST cache/fetch methodAlejandro Sirgo Rica2024-08-096-16/+69
| | | | | | | | | | | | | | | | | | | | | | Add API REST method to fetch an image. Consolidate image fetch loging for cache/fetch and image/restore. Resquest payload structure: { 'image': 'linux.img' 'type': 'TIPTORRENT' 'repository': '12.141.10.2' } The client will try to fetch'image' from 'repository' into cache. Resquest response structure: { 'cache': [ {'name': 'windows.img', 'size': 2432370213, checksum: '5d4dcc677bc19f40a647d0002f4ade90'}, {'name': 'linux.img', 'size': 243234534213, checksum: '3eb22f888f88a55ad954f55644e1192e'} ] }
* postinstall: ignore output when invoking legacy scriptsOpenGnSys Support Team2024-08-081-6/+12
| | | | output is never consumed.
* postinstall: add logging to report this stageOpenGnSys Support Team2024-08-081-0/+2
| | | | log that image restoration has entered OS configuration stage.
* live: move filesystem expansion out of OS configurationOpenGnSys Support Team2024-08-062-2/+2
| | | | just a clean up.
* postinstall: add logging to report postconfiguration script invocationOpenGnSys Support Team2024-08-061-0/+2
|
* postinstall: typo in maximum win hostname errorOpenGnSys Support Team2024-08-061-1/+1
| | | | s/nor/not
* postinstall: linux does not allow more than 64 bytes long hostnamesOpenGnSys Support Team2024-08-061-0/+4
| | | | | | | | | As per: $ getconf HOST_NAME_MAX 64 truncate it to the maximum.
* ogclient: remove external referenceOpenGnSys Support Team2024-08-061-1/+0
|
* live: use correct loglevel when reporting issues with listing cache contentsv1.3.2-14OpenGnSys Support Team2024-07-311-2/+2
| | | | instead of using info to report errors.
* utils: disk: revisit logging to find EFI partitionOpenGnSys Support Team2024-07-301-4/+5
| | | | | | | | | | | | | | instead of Checking partition "Microsoft Basic Data"... Checking partition "EFI System"... show Searching EFI partition... EFI partition found at /dev/sda1 and refer to EFI partition consistently in logs.
* utils: postinstall: show hostname in logsOpenGnSys Support Team2024-07-301-4/+4
| | | | Display the hostname that is set in the logs.
* live: validate checksum only once if image is already in cacheOpenGnSys Support Team2024-07-301-10/+15
| | | | | | | | | | | | | if image already exists in the cache, skip a second checksum validation. log shows duplicated entries: Verifying checksum for example.img, please wait... Checksum is OK for example.img Verifying checksum for example.img, please wait... Checksum is OK for example.img because tip_check_csum() is called twice in this case.
* live: remove old image and checksum file on downloadOpenGnSys Support Team2024-07-302-1/+15
| | | | | | | Restoring an updated image file (with different checksum) could fail while the old checksum file could remain in place. Remove image and checksum file before fetching the new files.
* utils: tip_check_csum() uses local checksum fileOpenGnSys Support Team2024-07-301-4/+13
| | | | | | | | | | | | | | | | | | | .full.sum file in the local cache contains the local checksum for this file, this checksum is calculated by tip_write_csum(), therefore, there is no need to calculate this checksum again from the image file in the cache, use this checksum content instead. if .full.sum is not available, then cache is inconsistent, tip_check_csum() is called after checking if image file exists, raise an exception. checksum could mismatch in two situations: a) new image version (checksum is different) b) image is corrupted in both cases, a new fresh image needs to be retrieved. this speeds up checksum validation.
* live: unicast-direct does not validate checksumOpenGnSys Support Team2024-07-301-0/+1
| | | | this restore method is unreliable, add warning to the logs.