Write Proxy Client API
Write Proxy Client API
Write Proxy is a 'stateless' service on managing the ownerships of writers of log streams. It is used to accept to fan-in writes from different publishers.
Build Client
The first thing of using Write Proxy service is to build the write proxy client. The endpoint of a Write Proxy service is typically identified by Finagle Name. Name strings must be supplied when constructing a Write Proxy client.
// 1. Create a Finagle client builder. It would be used for building connection to write proxies. ClientBuilder clientBuilder = ClientBuilder.get() .hostConnectionLimit(1) .hostConnectionCoresize(1) .tcpConnectTimeout(Duration$.MODULE$.fromMilliseconds(200)) .connectTimeout(Duration$.MODULE$.fromMilliseconds(200)) .requestTimeout(Duration$.MODULE$.fromSeconds(2)); // 2. Choose a client id to identify the client. ClientId clientId = ClientId$.MODULE$.apply("test"); String finagleNameStr = "inet!127.0.0.1:8000"; // 3. Create the write proxy client builder DistributedLogClientBuilder builder = DistributedLogClientBuilder.newBuilder() .name("test-writer") .clientId(clientId) .clientBuilder(clientBuilder) .statsReceiver(statsReceiver) .finagleNameStr(finagleNameStr); // 4. Build the client DistributedLogClient client = builder.build();
Write Records
Writing records to log streams via Write Proxy is much simpler than using the core library. The transaction id will be automatically assigned with timestamp by write proxies. The timestamp is guaranteed to be non-decreasing, which it could be treated as physical time within a log stream, and be used for implementing features like TTL in a strong consistent database.
DistributedLogClient client = ...; // Write a record to a stream String streamName = "test-stream"; byte[] data = ...; Future<DLSN> writeFuture = client.write(streamName, ByteBuffer.wrap(data)); Await.result(writeFuture);
Truncate Streams
Client could issue truncation requests (via #truncate(String, DLSN)) to write proxies to truncate a log stream up to a given position.
DistributedLogClient client = ...; // Truncate a stream to DLSN String streamName = "test-stream"; DLSN truncationDLSN = ...; Future<DLSN> truncateFuture = client.truncate(streamName, truncationDLSN); Await.result(truncateFuture);