As of v0.12.0 NOOOCL has switched its core native binding component from node-ffi to fastcall. It led to a significant performance increase (see fastcall becnhmarks). However, fastcall uses CMake.js as its build system instead of bundled node-gyp. It means NOOOCL has no Python 2 dependency anymore, but you gotta have CMake installed.
In Node.js JavaScript code is synchronous, single threaded. That means if you have an algorithm that can spawn tens of thousands of computation operations per second, your application will hang while the computation runs. No HTTP requests are served, no events are processed, there is nothing. You can overcome the above limitation by using some of the available threading modules (like Webworker Threads), but this has some serious limitations:
- There is no synchronization implemented in Node.js, so the inter-thread communication is allowed only by using messages. That means you can only exchange small, JSON serialized data between worker threads, and it is impossible to implement parallel algorithms that work on common data residing in memory buffers, like image processing for example.
- Code JIT-ed by V8 doesn't support SIMD instructions at the same level like that available in advanced C++ compilers. So while JavaScript code can be perfect for orchestrating large computation operations, it is not so good for writing them.
- Data parallelism is very hard to implement from scratch by using a only simple threading module, and it requires synchronization constructs that are not available in Node.js.
OpenCL is perfect to fill the gap. Besides solving the above issues it provides the following benefits:
- It supports GPU along with CPU based SSE/AVX instructions sets.
- It's supported by all the major GPU and CPU vendors.
- It's truly cross platform.
WebCL is gonna be the OpenCL for JavaScript (TM) at some time. It will be (should be) supported by all major browsers, to give web developers a powerful, cross platform computation platform for supporting algorithms like image processing in the client side. At least that's the plan.
Right now WebCL is a draft specification. There are plugins available for some browsers, but it is far from being a part of the modern web standards.
The problem is WebCL specification is a nerfed version of the OpenCL 1.0 with some support of minor Open CL 1.1 features. Right now OpenCL standard stays on version 2.0 which is a huge step forward from the 1.x line. When WebCL will be a released technology, it will be a toy compared to the mainline.
There is already a WebCL module for Node.js, if you are interested. But this module doesn't seem to be maintained for a while, and has strange dependencies for no apparent reason (you just don't need GLFW, GLEW, AntTweakBar and FreeImage to run OpenCL programs, trust me).
It's a full featured OpenCL wrapper library for Node.js. It supports full 1.1 and 1.2 specifications. Despite it's an OOP wrapper, the whole C API available by ffi, and can be called by using ref.
I know that there are some other OpenCL modules, but please check them out and then decide if there is a need for yet another OpenCL module for Node.js or not?
OpenCL 2.0?
I'm planning to support OCL 2.0 in the near future, it just depends on demand. Open up an issue or give a tlinkin' star to my repo, and I'll look into this as soon as possible.
io.js? 0.12?
Those versions are supported as well.
NPM:
npm install nooocl
JavaScript:
var nooocl = require('nooocl');
var CLHost = nooocl.CLHost;
var CLPlatform = nooocl.CLPlatform;
var CLDevice = nooocl.CLDevice;
var CLContext = nooocl.CLContext;
var CLBuffer = nooocl.CLBuffer;
var CLCommandQueue = nooocl.CLCommandQueue;
var CLUserEvent = nooocl.CLUserEvent;
var NDRange = nooocl.NDRange;
var CLProgram = nooocl.CLProgram;
var CLKernel = nooocl.CLKernel;
var CLImage2D = nooocl.CLImage2D;
var CLImage3D = nooocl.CLImage3D;
var CLSampler = nooocl.CLSampler;The OpenCL goodness is available through a CLHost instance.
host = CLHost.createV11(); // for OpenCL 1.1
host = CLHost.createV12(); // for OpenCL 1.2
host = new CLHost(1.1); // for OpenCL 1.1
host = new CLHost(1.2); // for OpenCL 1.2You will get an exception if there is no compatible OpenCL platform available.
CLHost and all of CL* class instances share these common, important properties:
- cl.version: version of the OpenCL platform
- cl.defs.xxx: predefined OpenCL values, like: CL_MEM_COPY_HOST_PTR, CL_DEVICE_MAX_COMPUTE_UNITS. See the OpenCL specification or NOOOCL/lib/cl/clDefines.js.
- cl.imports.clxxx: this is where OpenCL C API is imported with ffi, you can call native API methods like clEnqueueCopyBuffer, clEnqueueNDRangeKernel, etc.
- cl.types.xxx: ref compatible OpenCL type definitions, see the complete list there: NOOOCL/lib/cl/types.js.
Example:
var hostVersion = host.cl.version;
var someOpenCLValue = host.cl.defs.CL_MEM_COPY_HOST_PTR;
var err = host.cl.imports.clEnqueueNDRangeKernel(
queue.handle,
kernel.handle,
1,
null,
global.size,
null,
0,
null,
null);Then you can have access to the supported platforms:
var count = host.platformsCount;
// you will get an array filled with instances of nooocl.CLPlatform class
var allPlatforms = host.getPlatforms();For each platform you can access its information in JS properties:
var platform = host.getPlatforms()[0]; // First platform
var info = {
name: platform.name,
vendor: platform.vendor,
clVersion: platform.clVersion,
profile: platform.profile,
extensions: platform.extensions
};CLPlatform and all CL* class instances except CLHost share the handle property, which holds the value of cl_platform_id, cl_command_queue, cl_kernel, etc, OpenCL native handles. These handles will be automatically released during garbage collection, or they can be released explicitly by calling release method.
You can query available devices:
var all = platform.allDevices();
var cpus = platform.cpuDevices();
var gpus = platform.gpuDevices();
var accels = platform.accelDevices();
var gpusAndCpus =
platform.getDevices(
platform.cl.defs.CL_DEVICE_TYPE_GPU |
platform.cl.defs.CL_DEVICE_TYPE_CPU);You will get an array of nooocl.CLDevice class instances. CLDevice can provide all OpenCL device information in simple JavaScript properties, for example:
var cpuDevice = platform.cpuDevices()[0];
// you get the value of CL_DEVICE_MAX_COMPUTE_UNITS:
var maxComputeUnits = cpuDevice.maxComputeUnits;
// you get the value of CL_DEVICE_MAX_WORK_ITEM_SIZES in an array like: [256, 64, 1]:
var maxWorkItemSizes = cpuDevice.maxWorkItemSizes;Please see the API docs or NOOOCL/tests/hostTests.js unit test for complete list of available device info properties.
Ok, you have a host, a platform, a device, now you need a context. you can create it from a CLDevice instance, from an array of CLDevice instances, or from a CLPlatform instance and a device type, like:
// Create content for a single device:
var cpuDevice = platform.cpuDevices()[0];
context = new CLContext(cpuDevice);
// Create context for multiple devices:
var gpusAndCpus =
platform.getDevices(
platform.cl.defs.CL_DEVICE_TYPE_GPU |
platform.cl.defs.CL_DEVICE_TYPE_CPU);
context = new CLContext(gpusAndCpus);
// Create context for a platform's devices:
context = new CLContext(platform, platform.cl.defs.CL_DEVICE_TYPE_GPU);The last thing that you need in every OpenCL application is the command queue. You can create a queue for a device by calling CLCommandQueue class' constructor:
// The last two parameters are optional, their defaults are false:
var queue = new CLCommandQueue(context, cpuDevice, isOutOfOrder, isProfilingEnabled);CLCommandQueue implements every clEnqueue* method but the names are modified slightly, like: clEnqueueMarker becomes enqueueMarker, clEnqueueNDRangeKernel becomes enqueueNDRangeKernel, and so on. Please see the API docs further details.
The queue has two modes. Waitable and non waitable. A queue initially is non waitable. If the queue is non waitable its enqueue* methods return undefined, if waitable enqueue* methods return a CLEvent instance which have a promise property of type bluebird promise. You can switch modes by calling waitable method, which accepts an optional boolean parameter. When its true, the result queue will be waitable, if false, the result queue will be non waitable. Default value is true.
Example:
var queue = new CLCommandQueue(context, device); // It's non waitable.
// Fire and forget a kernel:
queue.enqueueNDRangeKernel(kernel, new NDRange(10));
// Read its result asynchronously:
queue.waitable().enqueueReadBuffer(
openCLBuffer,
0,
size_in_bytes,
destNodeJSBuffer).promise
.then(function () {
// Data is copied into host's destNodeJSBuffer from the device
});Please note there are no synchronous operations in NOOOCL, because those kill the event loop.
NOOOCL uses standard Node.js Buffer for memory pointers. Raw memory operations, like reinterpreting are implemented by using ref.
OpenCL runtime can allocate memory if requested.
var openCLBuffer = new CLBuffer(
context,
host.cl.defs.CL_MEM_ALLOC_HOST_PTR,
size_in_bytes_here);You can copy data into this buffer, and copy data from it into Node.js memory.
var destBuffer = new Buffer(openCLBuffer.size);
queue.waitable().enqueueReadBuffer(
openCLBuffer,
0,
openCLBuffer.size,
destBuffer).promise
.then(function () {
//destBuffer holds the data
// setting some values at Node.js side
ref.types.float.set(destBuffer, 0, 1.1);
ref.types.float.set(destBuffer, 1 * ref.types.float.size, 1.1);
// copy data back to OpenCL memory:
queue.enqueueWriteBuffer(openCLBuffer, 0, openCLBuffer.size, destBuffer);
});OpenCL buffers can be initialized by copying values from an already initialized Node.js Buffer.
var float = ref.types.float;
var nodeBuffer = new Buffer(float.size * 3);
float.set(nodeBuffer, 0, 1.1);
float.set(nodeBuffer, float.size, 2.2);
float.set(nodeBuffer, float.size * 2, 3.3);
var openCLBuffer = new CLBuffer(
context,
host.cl.defs.CL_MEM_COPY_HOST_PTR,
nodeBuffer.length,
nodeBuffer);
var otherBuffer = new Buffer(nodeBuffer.length);
queue.waitable().enqueueReadBuffer(
openCLBuffer,
0,
openCLBuffer.
size,
otherBuffer).promise
.then(function () {
// OpenCL buffer's data are copied to otherBuffer, check;
for (var i = 0; i < otherBuffer.length; i++) {
assert.equal(otherBuffer[i], nodeBuffer[i]);
}
});OpenCL can use Node.js buffers directly. It is safe to access its content only after a mapping operation.
var float = ref.types.float;
var nodeBuffer = new Buffer(float.size * 3);
float.set(nodeBuffer, 0, 1.1);
float.set(nodeBuffer, float.size, 2.2);
float.set(nodeBuffer, float.size * 2, 3.3);
var openCLBuffer = new CLBuffer(
context,
host.cl.defs.CL_MEM_USE_HOST_PTR,
nodeBuffer.length,
nodeBuffer);
// You can use the following shortcut syntax instead of the above constructor call:
// var openCLBuffer = CLBuffer.wrap(context, nodeBuffer);
var otherBuffer = new Buffer(nodeBuffer.length);
var out = {};
queue.enqueueMapBuffer(
openCLBuffer,
host.cl.defs.CL_MAP_READ | host.cl.defs.CL_MAP_WRITE,
1 * float.size, // offset
2 * float.size, // size
out).promise
.then(function() {
// out.ptr holds the mapped ptr address of ref type void*
// since you've requested the pointer from byte offset float.size,
// and OpenCL uses nodeBuffer's memory as host side pointer,
// then the following assertion holds:
assert.equal(
ref.address(out.ptr),
ref.address(nodeBuffer) + float.size);
// You should reinterpret result ptr to a usable sized buffer with ref:
var mappedBuffer = ref.reinterpret(out.ptr, 2 * float.size, 1 * float.size);
// Now you're using the same memory for sure:
for (var i = 0; i < mappedBuffer.length; i++) {
assert.equal(otherBuffer[i], nodeBuffer[i + float.size]);
}
// Why out.ptr if you have access the original buffer?
// That's because mapping is available for OpenCL allocated buffers as well,
// if CL_MEM_ALLOC_HOST_PTR flags is used only,
// or CL_MEM_USE_HOST_PTR flag is set along with CL_MEM_COPY_HOST_PTR
// ...
// After doing stuff, you have to unmap memory:
queue.enqueueUnmapMemory(openCLBuffer, out.ptr);
});2D and 3D images are also supported in NOOOCL. There is a unit test that shows how you can do OpenCL accelerated image grayscale conversion in NOOOCL, please take a look at it there: NOOOCL/tests/imageTests.js.
Fist, you should open the image and get access to its raw RGBA data in a Node.js buffer. Any appropriate npm module can be used for doing that. (I suggest lwip).
Then you can create and OpenCL image from it:
var ImageFormat = host.conel.types.ImageFormat;
var format = new ImageFormat({
imageChannelOrder: host.cl.defs.CL_RGBA,
imageChannelDataType: host.cl.defs.CL_UNSIGNED_INT8
});
// Wrap means CL_MEM_USE_HOST_PTR
var src = CLImage2D.wrapReadOnly(
context,
format,
inputImage.width,
inputImage.height,
inputImage.data);Please refer to the API docs for further details.
OpenCL programs can be compiled from string source code or loaded from pre-compiled binaries, these methods are supported in NOOOCL.
// Creating OpenCL program from string source:
var source = 'kernel void foo(global float* data) { }';
var program = context.createProgram(source);
// Everything is asynchronous in Node.js:
program.build('-cl-fast-relaxed-math').then(
function() {
// At this point you don't know that the build succeeded or failed.
// Since one context can hold multiple devices,
// and a build could succeeded on a device, but could failed on the other,
// NOOOCL won't raise build errors, you should asks for it per device basis:
// can be either: CL_BUILD_SUCCESS, CL_BUILD_ERROR
var buildStatus = program.getBuildStatus(device);
// Compiler output:
var buildLog = program.getBuildLog(device);
});After a program builds, you can access its binaries for each device:
// This returns an array of CLDevice instances
var devices = program.devices;
// This returns an array of Buffer instances
var binaries = program.getBinaries();
// According to the OpenCL Specification:
// "Each entry in this array is used by the implementation
// as the location in memory where to copy the program binary for a specific device,
// if there is a binary available. To find out which device
// the program binary in the array refers to,
// use the CL_PROGRAM_DEVICES query to get the list of devices.
// There is a one-to-one correspondence between the array of n pointers
// returned by CL_PROGRAM_BINARIES and array of devices
// returned by CL_PROGRAM_DEVICES."
// So you can zip the above:
var deviceBinaries =
_.zip(devices, binaries)
.map(function(a) { return { device: a[0], binary: a[1] }; );Binaries could be stored in files for example, so when the application executes next time, the slow build-from-source process won't be necessary.
// Creating program from binaries:
// This creates a Buffer instance:
var binary = fs.readFileSync('/tmp/foo.bin');
var program = context.createProgram(binary, device);
// You should call build,
// but this time it will be much faster than compiling from source:
program.build().then(
function() {
// can be either: CL_BUILD_SUCCESS, CL_BUILD_ERROR
var buildStatus = program.getBuildStatus(device);
// Compiler output:
var buildLog = program.getBuildLog(device);
// ...
});You can create kernel by name, or can create all kernels in the program at once.
// By name:
doStuffKernel = program.createKernel('doStuff');
// All. This time the return values is an array of CLKernel instances.
var kernels = program.createAllKernels();
doStuffKernel = _.first(_.where(kernels, { name: 'doStuff' }));You can set its arguments by index, or all at once:
// Assume you have a kernel of the following signature:
// kernel void doStuff(global float* data, uint someValue, local float* tmp) {...}
// and a CLBuffer instance created like:
// var openCLBuffer = CLBuffer.wrap(context, nodeBuffer);
var kernel = program.createKernel('doStuff');
// You can set kernel's arguments by index:
// For buffer arguments you can pass the instance of a CLBuffer class:
kernel.setArg(0, openCLBuffer);
// or native cl_mem handle
// kernel.setArg(0, openCLBuffer.handle);
// For constant arguments you have to specify its type
kernel.setArg(1, 55, 'uint');
// For local buffers, you have to specify its size in bytes
kernel.setArg(2, 100 * float.size);
// Or you can specify all of the arguments at once:
kernel.setArgs(openCLBuffer, {'uint': 55}, 100 * float.size);Now you can enqueue the kernel. In NOOOCL there is an NDRange class, for defining OpenCL ranges.
// 1 dimension range:
var r1 = new NDRange(10);
// 2 dimensions range:
var r2 = new NDRange(10, 20);
// 3 dimensions range
var r3 = new NDRange(10, 20, 30);So the enqueuing is really simple:
queue.enqueueNDRangeKernel(
kernel,
new NDRange(3), // global size
null, // local size
new NDRange(1) // offset
);You can create a simple JavaScript function for calling OpenCL kernels with ad-hoc arguments by using the bind method:
var func = kernel.bind(
queue, // command queue to use
new NDRange(3), // global size
null, // local size
new NDRange(1)); // offset
// Now you have a JS function to call (aka set arguments and enqueue)
// our OpenCL kernel!
// It's easy as goblin pie.
func(openCLBuffer, {'uint': 55}, 100 * float.size);I converted this OpenCL tutorial's C++ code to JavaScript: OAK RIDGE - OpenCL Vector Addition.
You can find the example there.
Slightly modified version of the above Vector Addition example to demonstrate how promise based asynchronous code can look in recent version of JavaScript (like synchronous code).
You can find the example there.