Timers, Coroutines and Threads

[zaunere]

Hello,

I have a few async things running: websocket stream, local event trigger (clock based), and calculations based on those.

Calculations are often kicked off on a time basis, so I've been working with Timer. However, it seems that it's finicky when it comes to running concurrently with other things. I've tried:

• separate coroutines, same context
• separate contexts
• separate threads
• thread queue to push back data to the main process

And various combinations of the above. Ideally I need the websocket/calculation processing to happen concurrently, with the timer performing a callback on said data. I've tried channels, shared variables, various combinations, yet the general problem is that I can't share a variable between the timer and main thread (or spawned coroutine or thread) while having both run concurrently.

It seems that either the timer runs, or the websocket stream runs, but not both, and not in a way that I can bounce data around (like reset counters on a timed basis).

Any thoughts/rules for where to place timers, ie. what they can't run alongside of concurrently? Ideally, I'd like to have a channel coming off the websocket (or thread queue) and be able to add timers as needed, such as:

timer::tick(100,function() use ($cnt) { $cnt = 0; });

while( $t = $chan->pop() )
{
if( $t[0] === 'P' )
++$cnt;
}

Thank you!

Hans

[zaunere]

Some follow-up info from compiling. With --enable-thread-context during compile it throws "thread context cannot be used with ZTS". Removing ZTS then throws "swoole thread must be used with ZTS". PHP 8.3.7 and latest from swoole-src on latest Fedora.

UPDATE: The only combo that worked was with ZTS and without thread-context. However strangeness continues:

<?php declare(strict_types=1);

use Swoole\Process as process;
use Swoole\Coroutine\System as sys;

$p_timer = new process(function() {
    echo "\nTimer PID: ".getmypid();
    $i = 5;
    while( --$i )
    {
        echo " $i ";
        sys::sleep(1);
    }
},false,SOCK_DGRAM,true);

$p_timer->signal(SIGALRM, function () {
    static $i = 0;
    echo "\n\n#{$i}\talarm\n";
    $i++;
});

$p_timer->alarm(100,0);

$p_timer->start();

process::wait();

Produces:

Timer PID: 418219 - 4  - 3  - 2  - 1 PHP Fatal error:  Could not set timer: Invalid argument (22) in Unknown on line 0

When trying to the use Swoole\Timer, it appears it's either the timer or a websocket stream, but not both concurrently. So far separate threads and even processes don't really work when trying to calc on the combined data. About the only thing I haven't tried is sockets/TCP server to fire off calcs.

Thanks,

Hans

[NathanFreeman]

Try using Swoole\Table to share data.

[zaunere]

Hi - I've been using queues to avoid data sync but I'll take another look at tables. Though maybe the issue a little deeper - from the example

<?php declare(strict_types=1);
use Swoole\Process;
use Swoole\Constant;
use Swoole\Coroutine as co;
use Swoole\Coroutine\System as sys;
use function Swoole\Coroutine\run;

// co::set([Constant::OPTION_HOOK_FLAGS => SWOOLE_HOOK_ALL,
//          'enable_preemptive_scheduler' => true,
//          'enable_coroutine' => true
// ]);

run(function () {
    Process::signal(SIGALRM, function () {
        static $i = 0;
        echo "#{$i}\talarm\n";
        $i++;
        if ($i > 20) {
            Process::alarm(-1);
            Process::kill(getmypid());
        }
    });

    //100ms
    Process::alarm(100 * 1000);

    while(true) {
        sys::sleep(0.5);
    }
});

Results in:

#18     alarm
#19     alarm
#20     alarm
PHP Warning:  Swoole\Process::alarm(): cannot use both 'timer' and 'alarm' at the same time in /mnt/build/working/qubit/wtf.php on line 19
Terminated

This is a build of the latest swoole/php releases.

]# php -ri swoole
PHP Parse error:  syntax error, unexpected end of file in Command line code on line 1

]# php -i | grep -i swoole
swoole
Swoole => enabled
Author => Swoole Team <[email protected]>
swoole.display_errors => On => On
swoole.enable_coroutine => On => On
swoole.enable_fiber_mock => Off => Off
swoole.enable_library => On => On
swoole.enable_preemptive_scheduler => Off => Off
swoole.unixsock_buffer_size => 8388608 => 8388608
swoole.use_shortname => On => On

./configure \
 --disable-all  --enable-option-checking  --prefix=/usr/local/feta  --with-layout=GNU  --with-libdir=lib64 \
 --disable-ipv6  --disable-cgi  --disable-fpm  --enable-cli  --with-pear  --enable-phar  --with-openssl \
 --with-readline  --with-zlib  --enable-opcache  --enable-opcache-jit  --enable-session  --enable-sockets \
 --enable-ctype  --enable-fileinfo  --enable-filter  --enable-posix  --enable-mbstring  --enable-dom \
 --enable-simplexml  --with-external-libcrypt  --enable-bcmath  --with-libxml  --with-iconv  --enable-tokenizer \
 --enable-xml  --enable-xmlreader  --enable-xmlwriter  --with-gettext  --with-readline  --enable-intl \
 --enable-shmop  --with-sodium  --with-zip  --with-curl  --enable-sysvmsg  --enable-sysvsem  --enable-sysvshm

./configure \
  --with-php-config=/usr/local/feta/bin/php-config \
  --enable-sockets --enable-openssl --enable-cares \
  --with-nghttp2-dir --enable-swoole-curl 

Any thoughts much appreciated, best,

Hans

And strace tail-end

write(1, "#18\talarm\n", 10#18  alarm
)            = 10
epoll_wait(4, [], 4096, 99)             = 0
epoll_wait(4, [{events=EPOLLIN, data={u32=62532336, u64=62532336}}], 4096, 500) = 1
read(5, "\16\0\0\0\0\0\0\0\200\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 128) = 128
write(1, "#19\talarm\n", 10#19  alarm
)            = 10
epoll_wait(4, [{events=EPOLLIN, data={u32=62532336, u64=62532336}}], 4096, 500) = 1
read(5, "\16\0\0\0\0\0\0\0\200\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 128) = 128
write(1, "#20\talarm\n", 10#20  alarm
)            = 10
write(2, "PHP Warning:  Swoole\\Process::al"..., 139PHP Warning:  Swoole\Process::alarm(): cannot use both 'timer' and 'alarm' at the same time in /mnt/build/working/qubit/wtf.php on line 19
) = 139
getpid()                                = 1615825
kill(1615825, SIGTERM)                  = 0
--- SIGTERM {si_signo=SIGTERM, si_code=SI_USER, si_pid=1615825, si_uid=0} ---
rt_sigaction(SIGTERM, NULL, {sa_handler=0x9ff8f0, sa_mask=~[ILL TRAP ABRT BUS FPE KILL SEGV CONT STOP TSTP TTIN TTOU SYS RTMIN RT_1], sa_flags=SA_RESTORER|SA_SIGINFO, sa_restorer=0x7f3bdb454dd0}, 8) = 0
rt_sigaction(SIGTERM, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=SA_RESTORER|SA_SIGINFO, sa_restorer=0x7f3bdb454dd0}, NULL, 8) = 0
rt_sigprocmask(SIG_UNBLOCK, [TERM], NULL, 8) = 0
getpid()                                = 1615825
kill(1615825, SIGTERM)                  = 0
--- SIGTERM {si_signo=SIGTERM, si_code=SI_USER, si_pid=1615825, si_uid=0} ---
+++ killed by SIGTERM +++
Terminated