Pull to refresh

My feed

Type
Rating limit
Level of difficulty
Warning
To set up filters sign in or sign up
Article

How to put the whole world into a regular laptop: PostgreSQL and OpenStreetMap

Level of difficultyEasy
Reading time12 min
Views3.3K

When a person used to say that he controls the whole world, he was usually placed in the next room with Napoleon Bonaparte. I hope that these times are in the past and everyone can analyze the geodata of the entire Earth and get answers to their global questions in minutes and seconds. I published Openstreetmap_h3 - my project, which allows you to perform geoanalytics on data from OpenStreetMap in PostGIS or in any query engine that can work with Apache Arrow / Parquet.

First of all, I say hello to the haters and skeptics. What I developed is really unique and solves the problem of transforming and analyzing geodata using the usual and familiar tools available to every analyst and data science specialist without bigdata, GPGPU, FPGA. What looks easy to use and code now is my personal project where I have invested my vacations, weekends, sleepless nights and a lot of personal time over the past 3 years. Maybe I will share the background of the project and the rake that I went through, but first I will still describe the end result.

Read more
Article

Roads and building density in North America. 100GB geodata processing OSM data in PostgreSQL

Reading time15 min
Views1.6K

Today I will discover America to you based on OpenStreetMap data in PostgreSQL15/PostGIS and my project openstreetmap_h3. Let's run the query and compare its execution time on the Citus column store in PostgreSQL and on the standard 100GB database partitioned by H3 geoindex.

We will find the top15 buildable locations in North America and the total length of roads, as well as their type and surface. I will not overload the publication with program logs, let's focus on the data! You can easily repeat all requests yourself on your laptop/computer.

Read more
Article

PyGMTSAR is Next Generation Interferometric Synthetic Aperture Radar (InSAR) Software for Everyone

Reading time6 min
Views3K

Do you need to produce satellite interferometry results for your work or study? Or should you find the way to process terabytes of radar data on your common laptop? Maybe you aren't confident about the installation and usage of the required software. Fortunately, there is the next generation of satellite interferometry products available for you. Beginners can build the results easily and advanced users might work on huge datasets. Open Source software PyGMTSAR is available on GitHub for developers and on DockerHub for advanced users and on Google Colab for everyone. This is the cloud-ready product, and it works the same as do you run it locally on your old laptop as on powerful cloud servers.


Read more →
Article

The first joint project with friends or how it turned out that each of us is good in his field

Level of difficultyEasy
Reading time3 min
Views691

Not so long ago, a good friend of mine suggested that I could make a mobile application that could allow him, as well as other less experienced football scouts, to be able to collect and store analytical information on football players, to provide reports to clubs or agencies and also to communicate with more advanced scouts.

How can it be useful?

At the moment, there is no analogue to similar applications in the Russian segment. This is because there is no great need for it. Clubs don't want to spend money on it, and agencies don't have such resources. Moreover, the implementation takes too much time. And scouts are used to working according to their own schemes and storing information in notebooks and so on. However, it does not mean that such an application cannot be useful for young scouts. It would teach you how to make reports correctly, focus on the data that football clubs and agencies are interested in, and would also allow you to select those scouts who would have potential.

By that time, I had already worked enough in mobile development to make such an application. However, the right approach for the implementation was required, in order to understand what this product should represent as a result, and also design.

By a lucky coincidence, the last question disappeared by itself because my friend's girlfriend was just finishing her design studies at Yekaterinburg University, so her graduation project became our design.

Read more
Article

From Zero to Hero: LeetCode

Level of difficultyMedium
Reading time8 min
Views30K

This is a translation of my article in Russian

In this article, I want to write about my experience of interacting with the LeetCode platform, and describe my preparation for an interview in FAANG similar companies by breaking it down into levels.

The whole article is written based on my experience, the numbers are very rough, I do not pretend to be objective, perhaps there are best practices on how to solve LeetCode problems, it would be cool if you share your experience in the comments.

Read more
Article

Best digital marketing agencies in Vancouver 2024

Level of difficultyEasy
Reading time11 min
Views1.5K

This year we conducted a survey of 78 purchasing managers from Forbes Global 2000 companies based in Vancouver, BC. Last year, Covid restrictions were eased, agency employees partially returned to their offices. This year has become a real challenge for agencies' CEOs, they had to find compromises with employees who did not want to return to the office, and at the same time manage projects at the same efficient level. Clutch is not the platform market can trust anymore because of the paid placements (sponsors and featured) that can cover up to 50 first positions in some cases. So we asked procurement managers in Vancouver to rate their digital marketing agencies from 0 to 10 based on the following criteria:

Read more
Article

Message broker selection cheat sheet: Kafka vs RabbitMQ vs Amazon SQS

Level of difficultyMedium
Reading time6 min
Views12K

This is a series of articles dedicated to the optimal choice between different systems on a real project or an architectural interview.

At work or at a System Design interview, you often have to choose the best message broker. I plunged into this issue and will tell you what and why. What is better in each case, what are the advantages and disadvantages of these systems, and which one to choose, I will show with several examples.

Read more
Article

Technical debt mini-guide. How to pay it off

Reading time7 min
Views2.3K

In this article, I want to describe my experience of paying off technical debt on our project in the form of a guide. In this guide, I will highlight some of the most common cases of technical debt and suggest methods for solving them. Since this is a rather extensive topic, I will recommend several books for study, because I do not see it possible to talk about everything within the framework of this article. Everything described applies to the BackEnd part, but it may be suitable for other developers. I would be glad if you share your experience on this topic in the comments.

Read more
Article

Everything You Should Know in Indian Premier League (IPL) 2023

Reading time4 min
Views1K

Image Credit: amazonspreview.com

Cricket in India is more than just a game and for most of it is a matter of pride and unity. As we all have grown up playing cricket and everyone knows all about its rules and techniques that are quite interesting. Over the last few years, the Indian premier league is the latest and most renowned version of cricket that has 20 overs. Within a short span of time, it has become one of the best sports traditions in India. 

Day by day the fanbase of IPL is increasing and there are many IPL live streaming cricket apps, where you can enjoy IPL matches. 

In this article, we will count everything you should know about IPL 2023. 

IPL 2023

The IPL is a professional T20 cricket league in India that was first begun in 2007 by the Board of control for cricket in India, and in 2023, it will be the 16th season of the premier league. Basically, it is contested by ten teams and annually it is held in summer across India between March to May. 

So, here is the team of IPL 2023.

IPL 2023 Teams 

Here is the list of the total teams of IPL 2023 and its players. 

Read more
Article

HDR Displays and CSS: Enhancing Color and Brightness on the Web

Level of difficultyEasy
Reading time3 min
Views5.5K

High Dynamic Range (HDR) allows for a wider range of colours and brightness levels. This technology works on displays that support HDR format. Nowadays web advantage of display gamuts such as Display P3 and Rec. 2020, which can display a much larger color space than traditional sRGB displays. It is 50% more colours.

CSS is ready to fix it (at least for Apple users). Find colour gamuts comparison, code examples and device support overview below.

Unlock HDR with CSS - read more
Article

Database selection cheat sheet: SQL or NoSQL?

Reading time9 min
Views5.2K

This is a series of articles dedicated to the optimal choice between different systems on a real project or an architectural interview.

This topic seemed relevant to me because such tasks can be encountered both at work and at an interview for System Design Interview and you will have to choose between these two types of DBMS. I plunged into this issue and will tell you what and how. What is better in each case, what are the advantages and disadvantages of these systems and which one to choose, I will show with several examples at the end of the article.

SQL or NoSQL?

Read more
Article

How Will Artificial Intelligence Influence Online Sports Betting?

Reading time4 min
Views2.7K

Online sports betting is a vertical of the gambling industry that has witnessed a massive surge in recent years. It is a great source of entertainment and thrill for online punters and bettors. Moreover, it also provides monetary benefits that are enough to entice the average layman. This is one of the most prominent reasons why people are gravitating towards these online sports betting platforms.

Additionally, the growing popularity of these platforms is urging sports betting software development companies to innovate and upgrade their platforms to cater to the growing needs of the user base. This is where Artificial Intelligence comes into the equation, AI has been at the forefront of innovations and development and has been offering users an enhanced user experience across multiple platforms. 

Artificial Intelligence technology has allowed Sports betting platforms to evolve with time and streamline their operations for better efficiency and enhanced productivity. This is why sports betting platforms all over the world are adopting this technology to offer better features and functionality to users and also increase their productivity and revenue. 

In this article, we will highlight how Artificial Intelligence has influenced the sports betting industry. So without further delay, let’s get started. 

Read more
Article

Q4 2022 DDoS Attacks and BGP Incidents

Reading time7 min
Views1.8K

Now that 2022 has come to an end, we would like to share the DDoS attack mitigation and BGP incident statistics for the fourth quarter of the year, which overall saw unprecedented levels of DDoS attack activity across all business sectors.

In 2022, DDoS attacks increased by 73.09% compared to 2021. 

Let's take a closer look at the Q4 2022 data.

Read more
News

Positive Hack Days 12 will be held in Gorky Park on May 19–20

Reading time2 min
Views1.1K

Following last year's cyberattacks, even previously laid-back people are now concerned about cybersecurity. That's why we decided to make the twelfth Positive Hack Days information security forum even more open and large-scale: it will be held at Gorky Park in Moscow on May 19 and 20, 2023. We've already started preparing for the event and are accepting applications from speakers. You can submit a talk topic until March 25.

Read more
Article

Data Phoenix Digest — ISSUE 2.2023

Reading time2 min
Views1.1K

Video recording of our webinar about dstack and reproducible ML workflows, AVL binary tree operations, Ultralytics YOLOv8, training XGBoost, productionize ML models, introduction to forecasting ensembles, domain expansion of image generators, Muse, X-Decoder, Box2Mask, RoDynRF, AgileAvatar and more.

Read more
Article

Building a GPT-like Model from Scratch with Detailed Theory and Code Implementation

Reading time14 min
Views38K

Unlock the power of Transformer Neural Networks and learn how to build your own GPT-like model from scratch. In this in-depth guide, we will delve into the theory and provide a step-by-step code implementation to help you create your own miniGPT model. The final code is only 400 lines and works on both CPUs as well as on the GPUs. If you want to jump straight to the implementation here is the GitHub repo.

Transformers are revolutionizing the world of artificial intelligence. This simple, but very powerful neural network architecture, introduced in 2017, has quickly become the go-to choice for natural language processing, generative AI, and more. With the help of transformers, we've seen the creation of cutting-edge AI products like BERT, GPT-x, DALL-E, and AlphaFold, which are changing the way we interact with language and solve complex problems like protein folding. And the exciting possibilities don't stop there - transformers are also making waves in the field of computer vision with the advent of Vision Transformers.

Read more
Article

NFun — expression evaluator for .Net

Reading time6 min
Views2.7K

Nfun is an embedded language and expression executor that supports primitive types, arrays, structures and lambda expressions.

Most likely, you have already met tasks that require such a tool, and in this article I want to show examples of its application, its capabilities and why it may be useful to you.

Let's learn some nFun!