{"id":6077,"date":"2021-03-15T19:36:05","date_gmt":"2021-03-15T18:36:05","guid":{"rendered":"https:\/\/florianbrinkmann.com\/en\/?p=6077"},"modified":"2021-03-15T19:36:07","modified_gmt":"2021-03-15T18:36:07","slug":"copy-directory-php","status":"publish","type":"post","link":"https:\/\/florianbrinkmann.com\/en\/copy-directory-php-6077\/","title":{"rendered":"Copying directory with many files in multiple steps via PHP"},"content":{"rendered":"\n

I am currently working on a side project, which needs to create a copy of a WordPress installation. Because I do not know the server environment where it is used by the users, I can neither expect that I can run Linux commands, nor that there is a long PHP max_execution_time<\/code>.<\/p>\n\n\n\n

So copying needs to be done via PHP and also work when, for example, the maximum execution time for scripts is 30 seconds. 30 seconds are not much for a script that should copy many files. Creating a list of the files and looping it without copying files can already take longer.<\/p>\n\n\n\n\n\n\n\n

Because of that, we need to do the copying in a way where we can save the current state when we are near the time limit, plan the next run, and exit. In the WordPress context, that is possible with WordPress cron events.<\/p>\n\n\n\n

I had issues finding a solution how to exclude already copied files from the next process so that they are not looped again.<\/p>\n\n\n\n

Symfony Finder component to the rescue<\/h2>\n\n\n\n

Relatively fast I came across the Finder component of Symfony<\/a>. The component allows finding directories and files by various rules and exclude other directories.<\/p>\n\n\n\n

So in a few steps, my solution looks like the following:<\/p>\n\n\n\n

  1. All files in the WordPress folder are searched, except the uploads directory.<\/li>
  2. Copying starts.<\/li>
  3. After finishing copying one folder, it is added to an array to be able to ignore it in the next run.<\/li>
  4. When almost reaching the timeout, the current state is saved to a file, a WP cron event is created and the program is finished.<\/li>
  5. When the cron event happens, the files from the not-yet processed directories are searched and it starts with step 2 again.<\/li><\/ol>\n\n\n\n

    My current code for that (not yet finished, but it works and should be enough for inspiration. Besides the Finder component I also use the\u00a0Filesystem component<\/a>\u00a0\u2014 the\u00a0code also exists as a Gist<\/a>).<\/p>\n\n\n

    <?php<\/span>\n<\/span><\/span>\/**<\/span>\n<\/span><\/span> * Main plugin code.<\/span>\n<\/span><\/span> *<\/span>\n<\/span><\/span> * @package<\/span> FlorianBrinkmann\\Copier<\/span>\n<\/span><\/span> *\/<\/span>\n<\/span><\/span>\n<\/span><\/span>namespace<\/span> FlorianBrinkmann<\/span>\\Copier<\/span>;\n<\/span><\/span>\n<\/span><\/span>use<\/span> Symfony<\/span>\\Component<\/span>\\Filesystem<\/span>\\Exception<\/span>\\IOExceptionInterface<\/span>;\n<\/span><\/span>use<\/span> Symfony<\/span>\\Component<\/span>\\Filesystem<\/span>\\Filesystem<\/span>;\n<\/span><\/span>use<\/span> Symfony<\/span>\\Component<\/span>\\Finder<\/span>\\Finder<\/span>;\n<\/span><\/span>\n<\/span><\/span>\/**<\/span>\n<\/span><\/span> * Class Plugin<\/span>\n<\/span><\/span> *<\/span>\n<\/span><\/span> * @package<\/span> FlorianBrinkmann\\Copier<\/span>\n<\/span><\/span> *\/<\/span>\n<\/span><\/span>class<\/span> Plugin<\/span> <\/span>{\n<\/span><\/span>\t\/**<\/span>\n<\/span><\/span>\t * Absolute path to the WordPress install.<\/span>\n<\/span><\/span>\t * <\/span>\n<\/span><\/span>\t * @var<\/span> string<\/span>\n<\/span><\/span>\t *\/<\/span>\n<\/span><\/span>\tprivate<\/span> $abspath = ''<\/span>;\n<\/span><\/span>\n<\/span><\/span>\t\/**<\/span>\n<\/span><\/span>\t * Absolute path where we want to copy the files to.<\/span>\n<\/span><\/span>\t * <\/span>\n<\/span><\/span>\t * @var<\/span> string<\/span>\n<\/span><\/span>\t *\/<\/span>\n<\/span><\/span>\tprivate<\/span> $dest = ''<\/span>;\n<\/span><\/span>\n<\/span><\/span>\t\/**<\/span>\n<\/span><\/span>\t * Name of destination directory.<\/span>\n<\/span><\/span>\t * <\/span>\n<\/span><\/span>\t * @var<\/span> string<\/span>\n<\/span><\/span>\t *\/<\/span>\n<\/span><\/span>\tprivate<\/span> $dest_dir_name = ''<\/span>;\n<\/span><\/span>\n<\/span><\/span>\t\/**<\/span>\n<\/span><\/span>\t * Array of default directories to exclude.<\/span>\n<\/span><\/span>\t * <\/span>\n<\/span><\/span>\t * @var<\/span> array<\/span>\n<\/span><\/span>\t *\/<\/span>\n<\/span><\/span>\tprivate<\/span> $default_exclude = [];\n<\/span><\/span>\n<\/span><\/span>\t\/**<\/span>\n<\/span><\/span>\t * Array of additional to exclude.<\/span>\n<\/span><\/span>\t * <\/span>\n<\/span><\/span>\t * @var<\/span> array<\/span>\n<\/span><\/span>\t *\/<\/span>\n<\/span><\/span>\tprivate<\/span> $additional_exclude = [];\n<\/span><\/span>\n<\/span><\/span>\t\/**<\/span>\n<\/span><\/span>\t * Path to status file.<\/span>\n<\/span><\/span>\t * <\/span>\n<\/span><\/span>\t * @var<\/span> string<\/span>\n<\/span><\/span>\t *\/<\/span>\n<\/span><\/span>\tprivate<\/span> $status_file;\n<\/span><\/span>\n<\/span><\/span>\t\/**<\/span>\n<\/span><\/span>\t * Current file index.<\/span>\n<\/span><\/span>\t * <\/span>\n<\/span><\/span>\t * @var<\/span> string<\/span>\n<\/span><\/span>\t *\/<\/span>\n<\/span><\/span>\tprivate<\/span> $current_file_index = ''<\/span>;\n<\/span><\/span>\n<\/span><\/span>\t\/**<\/span>\n<\/span><\/span>\t * Current path.<\/span>\n<\/span><\/span>\t * <\/span>\n<\/span><\/span>\t * @var<\/span> string<\/span>\n<\/span><\/span>\t *\/<\/span>\n<\/span><\/span>\tprivate<\/span> $current_path = ''<\/span>;\n<\/span><\/span>\n<\/span><\/span>\t\/**<\/span>\n<\/span><\/span>\t * Tables of WordPress install.<\/span>\n<\/span><\/span>\t * <\/span>\n<\/span><\/span>\t * @var<\/span> array<\/span>\n<\/span><\/span>\t *\/<\/span>\n<\/span><\/span>\tprivate<\/span> $tables = [];\n<\/span><\/span>\n<\/span><\/span>\t\/**<\/span>\n<\/span><\/span>\t * The current step of the process.<\/span>\n<\/span><\/span>\t * <\/span>\n<\/span><\/span>\t * @var<\/span> string<\/span>\n<\/span><\/span>\t *\/<\/span>\n<\/span><\/span>\tprivate<\/span> $step = ''<\/span>;\n<\/span><\/span>\n<\/span><\/span>\t\/**<\/span>\n<\/span><\/span>\t * Time limit in seconds. Default 30.<\/span>\n<\/span><\/span>\t * <\/span>\n<\/span><\/span>\t * @var<\/span> int<\/span>\n<\/span><\/span>\t *\/<\/span>\n<\/span><\/span>\tprivate<\/span> $time_limit = 30<\/span>;\n<\/span><\/span>\n<\/span><\/span>\t\/**<\/span>\n<\/span><\/span>\t * Unix timestamp of init event.<\/span>\n<\/span><\/span>\t * <\/span>\n<\/span><\/span>\t * @var<\/span> int<\/span>\n<\/span><\/span>\t *\/<\/span>\n<\/span><\/span>\tprivate<\/span> $timer;\n<\/span><\/span>\n<\/span><\/span>\t\/**<\/span>\n<\/span><\/span>\t * Symfony filesystem object.<\/span>\n<\/span><\/span>\t * <\/span>\n<\/span><\/span>\t * @var<\/span> Filesystem<\/span>\n<\/span><\/span>\t *\/<\/span>\n<\/span><\/span>\tprivate<\/span> $filesystem;\n<\/span><\/span>\n<\/span><\/span>\t\/**<\/span>\n<\/span><\/span>\t * List of directories and files.<\/span>\n<\/span><\/span>\t * <\/span>\n<\/span><\/span>\t * @var<\/span> array<\/span>\n<\/span><\/span>\t *\/<\/span>\n<\/span><\/span>\tprivate<\/span> $files_list;\n<\/span><\/span>\n<\/span><\/span>\tpublic<\/span> function<\/span> init<\/span>()<\/span> <\/span>{\n<\/span><\/span>\t\t\/\/ Set timer.<\/span>\n<\/span><\/span>\t\t$this<\/span>->timer = time();\n<\/span><\/mark>\n<\/span><\/span>\t\t\/\/ Set filesystem property.<\/span>\n<\/span><\/span>\t\t$this<\/span>->filesystem = new<\/span> Filesystem();\n<\/span><\/span>\n<\/span><\/span>\t\t$this<\/span>->step = 'file-list-creation'<\/span>;\n<\/span><\/span>\n<\/span><\/span>\t\t\/\/ Set dest folder for copying.<\/span>\n<\/span><\/span>\t\t$dest_dir_name = uniqid( 'uaas-copy-'<\/span> );\n<\/span><\/mark>\n<\/span><\/span>\t\t\/\/ Check if folder exists. If so, change name and check again.<\/span>\n<\/span><\/span>\t\t\/\/ @todo:<\/span> Only check for a limited time.<\/span>\n<\/span><\/span>\t\twhile<\/span> ( $this<\/span>->filesystem->exists( \"$this->abspath\/$dest_dir_name\"<\/span> ) ) {\n<\/span><\/span>\t\t\t$dest_dir_name = uniqid( 'uaas-copy-'<\/span> );\n<\/span><\/span>\t\t}\n<\/span><\/span>\n<\/span><\/span>\t\t$this<\/span>->dest_dir_name = $dest_dir_name;\n<\/span><\/span>\t\t\n<\/span><\/span>\t\t$this<\/span>->dest = trailingslashit( \"$this->abspath{$dest_dir_name}\"<\/span> );\n<\/span><\/span>\n<\/span><\/span>\t\t\/\/ Create file list for cloning.<\/span>\n<\/span><\/span>\t\t$this<\/span>->default_exclude = [ 'wp-content\/uploads'<\/span>, $this<\/span>->dest_dir_name ];\n<\/span><\/mark>\t\t$this<\/span>->create_file_list();\n<\/span><\/mark>\n<\/span><\/span>\t\t\/\/ Create dest folder.<\/span>\n<\/span><\/span>\t\t$this<\/span>->filesystem->mkdir( $this<\/span>->dest, 0755<\/span> );\n<\/span><\/span>\n<\/span><\/span>\t\t\/\/ Create status file.<\/span>\n<\/span><\/span>\t\t$this<\/span>->status_file = \"{$this->dest}uaas-status.txt\"<\/span>;\n<\/span><\/mark>\t\t$this<\/span>->filesystem->dumpFile( $this<\/span>->status_file, serialize( $this<\/span> ) );\n<\/span><\/mark>\n<\/span><\/span>\t\t\/\/ We have the files in the files_list property now, so we can clone!<\/span>\n<\/span><\/span>\t\t$this<\/span>->step = 'copying-files'<\/span>;\n<\/span><\/span>\t\t$this<\/span>->copy_files();\n<\/span><\/mark>\t}\n<\/span><\/span>\n<\/span><\/span>\t\/**<\/span>\n<\/span><\/span>\t * Continue copying.<\/span>\n<\/span><\/span>\t *\/<\/span>\n<\/span><\/span>\tpublic<\/span> function<\/span> continue_copying<\/span>()<\/span> <\/span>{\n<\/span><\/mark>\t\t\/\/ Check for step.<\/span>\n<\/span><\/mark>\t\tif<\/span> ( $this<\/span>->step !== 'copying-files'<\/span> ) {\n<\/span><\/mark>\t\t\treturn<\/span> false<\/span>;\n<\/span><\/mark>\t\t}\n<\/span><\/mark>\n<\/span><\/mark>\t\t\/\/ Set timer.<\/span>\n<\/span><\/mark>\t\t$this<\/span>->timer = time();\n<\/span><\/mark>\n<\/span><\/mark>\t\t\/\/ Update file list.<\/span>\n<\/span><\/mark>\t\t$this<\/span>->create_file_list();\n<\/span><\/mark>\n<\/span><\/mark>\t\t$this<\/span>->copy_files();\n<\/span><\/mark>\t}\n<\/span><\/mark>\n<\/span><\/span>\t\/**<\/span>\n<\/span><\/span>\t * Create a list of the files that we want to copy.<\/span>\n<\/span><\/span>\t *\/<\/span>\n<\/span><\/span>\tprivate<\/span> function<\/span> create_file_list<\/span>()<\/span> <\/span>{\n<\/span><\/mark>\t\t$finder = new<\/span> Finder();\n<\/span><\/mark>\n<\/span><\/mark>\t\t\/\/ @todo:<\/span> check for modified uploads destination.<\/span>\n<\/span><\/mark>\t\t\/\/ @todo:<\/span> ignore other directories like cache, backups, \u2026<\/span>\n<\/span><\/mark>\t\t$exclude = array_merge( $this<\/span>->default_exclude, $this<\/span>->additional_exclude );\n<\/span><\/mark>\t\t$finder->files()->in( $this<\/span>->abspath )->exclude( $exclude )->notPath( '\/.*\\\/node_modules\\\/.*\/'<\/span> );\n<\/span><\/mark>\n<\/span><\/mark>\t\tif<\/span> ( ! $finder->hasResults() ) {\n<\/span><\/mark>\t\t\t\/\/ @todo:<\/span> Add error, nothing found.<\/span>\n<\/span><\/mark>\n<\/span><\/mark>\t\t\treturn<\/span>;\n<\/span><\/mark>\t\t}\n<\/span><\/mark>\n<\/span><\/mark>\t\t$this<\/span>->files_list = $finder;\n<\/span><\/mark>\t}\n<\/span><\/mark>\n<\/span><\/span>\t\/**<\/span>\n<\/span><\/span>\t * Copy the files.<\/span>\n<\/span><\/span>\t *\/<\/span>\n<\/span><\/span>\tprivate<\/span> function<\/span> copy_files<\/span>()<\/span> <\/span>{\n<\/span><\/mark>\t\t\/\/ Loop the files list.<\/span>\n<\/span><\/span>\t\t$already_processed = true<\/span>;\n<\/span><\/span>\t\tforeach<\/span> ( $this<\/span>->files_list as<\/span> $index => $file ) {\t\n<\/span><\/mark>\t\t\t\/\/ Check if we already had that file.<\/span>\n<\/span><\/span>\t\t\tif<\/span> ( $this<\/span>->current_file_index === ''<\/span> ) {\n<\/span><\/span>\t\t\t\t$already_processed = false<\/span>;\n<\/span><\/span>\t\t\t} else<\/span> if<\/span> ( $this<\/span>->current_file_index === $index ) {\n<\/span><\/span>\t\t\t\t$already_processed = false<\/span>;\n<\/span><\/span>\t\t\t}\n<\/span><\/span>\n<\/span><\/span>\t\t\tif<\/span> ( $already_processed ) {\n<\/span><\/span>\t\t\t\tcontinue<\/span>;\n<\/span><\/span>\t\t\t}\n<\/span><\/span>\n<\/span><\/span>\t\t\t$tmp = str_replace( '\\\\'<\/span>, '\/'<\/span>, $file->getRelativePath() );\n<\/span><\/mark>\n<\/span><\/mark>\t\t\t\/\/ Check if current path is not empty.<\/span>\n<\/span><\/mark>\t\t\tif<\/span> ( $this<\/span>->current_path !== ''<\/span> ) {\n<\/span><\/mark>\t\t\t\t\/\/ Now check if the path of prev file<\/span>\n<\/span><\/mark>\t\t\t\t\/\/ does not exist in path of current file.<\/span>\n<\/span><\/mark>\t\t\t\tif<\/span> ( strpos( $tmp, $this<\/span>->current_path ) !== 0<\/span> ) {\n<\/span><\/mark>\t\t\t\t\t$pushed_to_array = false<\/span>;\n<\/span><\/mark>\t\t\t\t\t\/\/ Add prev path to exclude in conditional cases.<\/span>\n<\/span><\/mark>\n<\/span><\/mark>\t\t\t\t\t\/\/ Add it if is wp-admin folder or a direct subfolder.<\/span>\n<\/span><\/mark>\t\t\t\t\tif<\/span> ( strpos( $this<\/span>->current_path, 'wp-admin'<\/span> ) === 0<\/span> && substr_count( $this<\/span>->current_path, '\/'<\/span> ) <= 1<\/span> ) {\n<\/span><\/mark>\t\t\t\t\t\tarray_push( $this<\/span>->additional_exclude, untrailingslashit( $this<\/span>->current_path ) );\n<\/span><\/mark>\t\t\t\t\t\t$pushed_to_array = true<\/span>;\n<\/span><\/mark>\t\t\t\t\t}\n<\/span><\/mark>\t\t\t\t\t\n<\/span><\/mark>\t\t\t\t\t\/\/ Add it if is wp-content folder or up to two levels deeper.<\/span>\n<\/span><\/mark>\t\t\t\t\tif<\/span> ( strpos( $this<\/span>->current_path, 'wp-content'<\/span> ) === 0<\/span> ) {\n<\/span><\/mark>\t\t\t\t\t\t\/\/ Get first three directories of paths.<\/span>\n<\/span><\/mark>\t\t\t\t\t\t\/\/ https:\/\/stackoverflow.com\/a\/1935929\/7774451<\/span>\n<\/span><\/mark>\t\t\t\t\t\t$path_parts = explode( '\/'<\/span>, $this<\/span>->current_path, 4<\/span> );\n<\/span><\/mark>\t\t\t\t\t\tif<\/span> ( isset<\/span> ( $path_parts[3<\/span>] ) ) {\n<\/span><\/mark>\t\t\t\t\t\t\tunset<\/span>( $path_parts[3<\/span>] );\n<\/span><\/mark>\t\t\t\t\t\t}\n<\/span><\/mark>\n<\/span><\/mark>\t\t\t\t\t\t$tmp_path_parts = explode( '\/'<\/span>, $tmp, 4<\/span> );\n<\/span><\/mark>\t\t\t\t\t\tif<\/span> ( isset<\/span> ( $tmp_path_parts[3<\/span>] ) ) {\n<\/span><\/mark>\t\t\t\t\t\t\tunset<\/span>( $tmp_path_parts[3<\/span>] );\n<\/span><\/mark>\t\t\t\t\t\t}\n<\/span><\/mark>\n<\/span><\/mark>\t\t\t\t\t\t\/\/ If both arrays would be the same, that means we are deeper than three subdirs.<\/span>\n<\/span><\/mark>\t\t\t\t\t\t\/\/ CHECK WHY THAT DOES NOT WORK FOR ANTISPAM-BEE AND ANTISPAM-BEE-3-0<\/span>\n<\/span><\/mark>\t\t\t\t\t\tif<\/span> ( $path_parts !== $tmp_path_parts ) {\n<\/span><\/mark>\t\t\t\t\t\t\t\/\/ Push the path from $path_parts.<\/span>\n<\/span><\/mark>\t\t\t\t\t\t\tarray_push( $this<\/span>->additional_exclude, implode( '\/'<\/span>, $path_parts ) );\n<\/span><\/mark>\t\t\t\t\t\t\t$pushed_to_array = true<\/span>;\t\n<\/span><\/mark>\t\t\t\t\t\t}\n<\/span><\/mark>\t\t\t\t\t}\n<\/span><\/mark>\n<\/span><\/mark>\t\t\t\t\t\/\/ Remove entries from exclude that are covered by more general rules.<\/span>\n<\/span><\/mark>\t\t\t\t\tif<\/span> ( $pushed_to_array ) {\n<\/span><\/mark>\t\t\t\t\t\t$filtered = array_filter( $this<\/span>->additional_exclude, function<\/span>( $var )<\/span> <\/span>{\n<\/span><\/mark>\t\t\t\t\t\t\t\/\/ Check if $var is equal with current_path.<\/span>\n<\/span><\/mark>\t\t\t\t\t\t\tif<\/span> ( $var === untrailingslashit( $this<\/span>->current_path ) ) {\n<\/span><\/mark>\t\t\t\t\t\t\t\treturn<\/span> true<\/span>;\n<\/span><\/mark>\t\t\t\t\t\t\t}\n<\/span><\/mark>\n<\/span><\/mark>\t\t\t\t\t\t\t\/\/ If $var contains $this->current_path, remove it.<\/span>\n<\/span><\/mark>\t\t\t\t\t\t\tif<\/span> ( strpos( $var, untrailingslashit( $this<\/span>->current_path ) ) === 0<\/span> ) {\n<\/span><\/mark>\t\t\t\t\t\t\t\treturn<\/span> false<\/span>;\n<\/span><\/mark>\t\t\t\t\t\t\t}\n<\/span><\/mark>\n<\/span><\/mark>\t\t\t\t\t\t\treturn<\/span> true<\/span>;\n<\/span><\/mark>\t\t\t\t\t\t} );\n<\/span><\/mark>\n<\/span><\/mark>\t\t\t\t\t\t$this<\/span>->additional_exclude = $filtered;\n<\/span><\/mark>\t\t\t\t\t}\n<\/span><\/mark>\t\t\t\t} \n<\/span><\/mark>\t\t\t}\n<\/span><\/span>\n<\/span><\/span>\t\t\t$this<\/span>->current_path = str_replace( '\\\\'<\/span>, '\/'<\/span>, $file->getRelativePath() );\n<\/span><\/span>\n<\/span><\/span>\t\t\t$absolute_file_path = str_replace( '\\\\'<\/span>, '\/'<\/span>, $file->getRealPath() );\n<\/span><\/span>\n<\/span><\/span>\t\t\t\/\/ Create dest path for file.<\/span>\n<\/span><\/span>\t\t\t$dest_file_path = str_replace( $this<\/span>->abspath, $this<\/span>->dest, $absolute_file_path );\n<\/span><\/span>\n<\/span><\/span>\t\t\t\/\/ Copy the file.<\/span>\n<\/span><\/span>\t\t\ttry<\/span> {\n<\/span><\/span>\t\t\t\t$this<\/span>->filesystem->copy( $absolute_file_path, $dest_file_path );\n<\/span><\/mark>\t\t\t} catch<\/span> ( IOExceptionInterface $exception ) {\n<\/span><\/span>\t\t\t\t\/\/ @todo:<\/span> make something with the error.<\/span>\n<\/span><\/span>\t\t\t}\n<\/span><\/span>\n<\/span><\/span>\t\t\t\/\/ Check if we are near the self-defined script timeout limit.<\/span>\n<\/span><\/span>\t\t\tif<\/span> ( time() - $this<\/span>->timer >= $this<\/span>->time_limit - 1<\/span> ) {\n<\/span><\/mark>\t\t\t\t$this<\/span>->current_file_index = $index;\n<\/span><\/mark>\n<\/span><\/mark>\t\t\t\t\/\/ Store the current object in a file.<\/span>\n<\/span><\/mark>\t\t\t\t$this<\/span>->filesystem->dumpFile( $this<\/span>->status_file, serialize( $this<\/span> ) );\n<\/span><\/mark>\n<\/span><\/mark>\t\t\t\t\/\/ Add a new cron event in the near future to continue the copying.<\/span>\n<\/span><\/mark>\t\t\t\twp_schedule_single_event( time(), 'flobn_uaas_continue_copying'<\/span>, [ $this<\/span>->status_file ] );\n<\/span><\/mark>\n<\/span><\/mark>\t\t\t\t\/\/ Exit.<\/span>\n<\/span><\/mark>\t\t\t\texit<\/span>();\n<\/span><\/mark>\t\t\t}\n<\/span><\/mark>\t\t}\n<\/span><\/span>\n<\/span><\/span>\t\terror_log( 'Finished file copying'<\/span> );\n<\/span><\/span>\t}\n<\/span><\/span>\n<\/span><\/span>\tpublic<\/span> function<\/span> set_abspath<\/span>( string $abspath )<\/span> <\/span>{\n<\/span><\/span>\t\t\/\/ Replace backslash with slash.<\/span>\n<\/span><\/span>\t\t$abspath = str_replace( '\\\\'<\/span>, '\/'<\/span>, $abspath );\n<\/span><\/span>\t\t$this<\/span>->abspath = trailingslashit( $abspath );\n<\/span><\/span>\t}\n<\/span><\/span>}\n<\/span><\/span>\n<\/span><\/span><\/code><\/span>Code language:<\/span> PHP<\/span> (<\/span>php<\/span>)<\/span><\/small><\/pre>\n\n\n
    To start the process, we need to run the following code (the class file needs to be included, too, for example, via the Composer autoloader):<\/p>\n\n\n
    namespace<\/span> FlorianBrinkmann<\/span>\\Copier<\/span>;\n\n\/\/ Load Composer autoloader. From https:\/\/github.com\/brightnucleus\/jasper-client\/blob\/master\/tests\/bootstrap.php#L55-L59<\/span>\n$autoloader = dirname( __FILE__<\/span> ) . '\/vendor\/autoload.php'<\/span>;\nif<\/span> ( is_readable( $autoloader ) ) {\n\trequire_once<\/span> $autoloader;\n}\n\n\/\/ Create Plugin object.\t<\/span>\n$uaas = new<\/span> Plugin();\n\n\/\/ Set abspath property.<\/span>\n$uaas->set_abspath( ABSPATH );\n\n$uaas->init();<\/code><\/span>Code language:<\/span> PHP<\/span> (<\/span>php<\/span>)<\/span><\/small><\/pre>\n\n\n
    Now the explanation of the most important parts:<\/p>\n\n\n\n
    • Line 120: timer<\/code> property is set to the current timestamp to later be able to check the script runtime.<\/li>
    • Line 128: A directory name for the target folder is generated and it is checked if it already exists.<\/li>
    • Lines 141 and 142: The directories to exclude by default are the uploads folder and the target folder. After that, the file list is generated.<\/li>
    • Lines 177-192: Running the Symfony Finder in line 183. In addition to our ignore rules and the ones that come from the Finder component by default (version control directories, for example), we also exclude node_modules<\/code> folders. In line 191 the Finder object is stored in the files_list<\/code> property.<\/li>
    • Lines 148 and 149: We create a status file in the target directory and save the current object ($this<\/code>) to it.<\/li>
    • Line 153: We start copying.<\/li>
    • Line 197 following: The method for copying the files. We loop the files list and check if a file was already copied by waiting until the index of the last processed file is there (the files are always in the same order, and the index of the current file is set in line 288). All files before the index can be ignored because they are already processed.<\/li>
    • Starting line 212, we begin with the check for fully processed directories. We cannot use all folders, because that would crash the Finder<\/code>. We limit it to direct subdirectories in the wp-admin<\/code> folder and two levels of subdirectories in the wp-content<\/code> folder, so, for example, wp-content\/plugins\/antispam-bee<\/code>.<\/li>
    • In lines 252 to 268, we check if $this->additional_exclude<\/code> contains folders that are matched by other entries and remove them. That would be the case for plugin folders after the whole wp-content\/plugins<\/code> directory is processed.<\/li>
    • In line 281 the file is copied.<\/li>
    • The lines 287 to 289, we check if we are near the timelimit by one second. If that is the case, the currently processed file is saved in current_file_index<\/code> and the current object in our state file. After that, the cron event is planned that executes the flobn_uaas_continue_copying<\/code> hook and gets the path to the status file as a parameter.<\/li>
    • Lines 159-172: The function that is hooked to flobn_uaas_continue_copying<\/code> calls the continue_copying()<\/code> method. In it we check it step<\/code> is copying-files<\/code> and if that is true, we set the timer<\/code>, create our file list (in create_file_list()<\/code> also the processed directories are ignored) and continue with copying.<\/li><\/ul>\n\n\n\n
      The action that is called by the cron event looks like this:<\/p>\n\n\n
      add_action( 'flobn_uaas_continue_copying'<\/span>, function<\/span>( $status_file )<\/span> <\/span>{\n\t\/\/ Get status file.<\/span>\n\t$status_file_contents = file_get_contents( $status_file );\n\n\t\/\/ unserialize object.<\/span>\n\t$uaas = unserialize( $status_file_contents );\n\n\t\/\/ Continue with copying.<\/span>\n\t$uaas->continue_copying();\n} );<\/code><\/span>Code language:<\/span> PHP<\/span> (<\/span>php<\/span>)<\/span><\/small><\/pre>\n\n\n
      We get the content of the status file, undo serialization of the object and run the continue_copying()<\/code> method.<\/p>\n\n\n\n
      And that is it, we have a process that even with a short execution time can copy large folders \ud83c\udf89<\/p>\n\n\n\n
      If copying one file needs a long time, that could of course lead to a timeout error, because the check is done after copying and not in between. But it should be a good starting point.<\/p>\n","protected":false},"excerpt":{"rendered":"
      I am currently working on a side project, which needs to create a copy of a WordPress installation. Because I do not know the server environment where it is used by the users, I can neither expect that I can run Linux commands, nor that there is a long PHP max_execution_time. So copying needs to […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"wpf_show_in_dewp_planet_feed":false,"flobn_post_versions":"","webmentions_disabled_pings":false,"webmentions_disabled":false,"lazy_load_responsive_images_disabled":false,"footnotes":""},"categories":[115],"tags":[],"class_list":["post-6077","post","type-post","status-publish","format-standard","hentry","category-wordpress-snippets"],"wp-worthy-pixel":{"ignored":false,"public":"b3c75a41684749738b195b0f2702d680","server":"vg07.met.vgwort.de","url":"https:\/\/vg07.met.vgwort.de\/na\/b3c75a41684749738b195b0f2702d680"},"wp-worthy-type":"normal","_links":{"self":[{"href":"https:\/\/florianbrinkmann.com\/en\/wp-json\/wp\/v2\/posts\/6077","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/florianbrinkmann.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/florianbrinkmann.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/florianbrinkmann.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/florianbrinkmann.com\/en\/wp-json\/wp\/v2\/comments?post=6077"}],"version-history":[{"count":2,"href":"https:\/\/florianbrinkmann.com\/en\/wp-json\/wp\/v2\/posts\/6077\/revisions"}],"predecessor-version":[{"id":6079,"href":"https:\/\/florianbrinkmann.com\/en\/wp-json\/wp\/v2\/posts\/6077\/revisions\/6079"}],"wp:attachment":[{"href":"https:\/\/florianbrinkmann.com\/en\/wp-json\/wp\/v2\/media?parent=6077"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/florianbrinkmann.com\/en\/wp-json\/wp\/v2\/categories?post=6077"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/florianbrinkmann.com\/en\/wp-json\/wp\/v2\/tags?post=6077"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}